[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:35 dist-test-slave-cbbz krb5kdc[21018](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:35 dist-test-slave-cbbz krb5kdc[21018](info): set up 2 sockets
Aug 11 14:25:35 dist-test-slave-cbbz krb5kdc[21018](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 14:25:36.968467 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:37.093302 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45423
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:45423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:37.183030 21033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:37.183287 21033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:37.183326 21033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:37.184491 21033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:37.184568 21033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:37.184597 21033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:37.184628 21033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:37.184646 21033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:37.186303 21033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:45423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:37.186721 21033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:37.187000 21033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:37.193444 21041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:37.193475 21039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:37.195226 21033 server_base.cc:1034] running on GCE node
W20260811 14:25:37.195441 21038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:37.195779 21033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:37.196249 21033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:37.197417 21033 hybrid_clock.cc:648] HybridClock initialized: now 1786458337197375 us; error 61 us; skew 500 ppm
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:37.200310 21033 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:37.200991 21033 webserver.cc:460] Webserver started at http://127.20.132.254:45155/ using document root <none> and password file <none>
I20260811 14:25:37.201323 21033 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:37.201375 21033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:37.201570 21033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:37.202790 21033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "e3f97a0709ab422582fe9ebd36b4b5cb"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "e600da0c18d68d5147847c2177f89f29"
server_key_iv: "b34a5c09ae2bc45e593bbccc4e17dff3"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.203186 21033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "e3f97a0709ab422582fe9ebd36b4b5cb"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "e600da0c18d68d5147847c2177f89f29"
server_key_iv: "b34a5c09ae2bc45e593bbccc4e17dff3"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.205134 21033 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 14:25:37.206169 21048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.206465 21033 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:37.206579 21033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "e3f97a0709ab422582fe9ebd36b4b5cb"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "e600da0c18d68d5147847c2177f89f29"
server_key_iv: "b34a5c09ae2bc45e593bbccc4e17dff3"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.206663 21033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:37.228201 21033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:37.230665 21033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:37.230890 21033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:37.236151 21033 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:45423
I20260811 14:25:37.236301 21106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:45423 every 8 connection(s)
I20260811 14:25:37.236809 21033 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:37.238251 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:37.239074 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21033
I20260811 14:25:37.239199 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:37.240047 21011 external_mini_cluster.cc:1428] Setting key cc2af02632fca77b6dae560b5dd2b503
I20260811 14:25:37.242784 21107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb: Bootstrap starting.
I20260811 14:25:37.243712 21107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:37.244230 21107 log.cc:824] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:37.245206 21107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb: No bootstrap required, opened a new log
I20260811 14:25:37.248083 21107 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45423 } }
I20260811 14:25:37.248379 21107 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:37.248531 21107 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f97a0709ab422582fe9ebd36b4b5cb, State: Initialized, Role: FOLLOWER
I20260811 14:25:37.248767 21107 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45423 } }
I20260811 14:25:37.248940 21107 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:37.248996 21107 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:37.249049 21107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:37.249691 21107 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45423 } }
I20260811 14:25:37.249912 21107 leader_election.cc:302] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3f97a0709ab422582fe9ebd36b4b5cb; no voters:
I20260811 14:25:37.250154 21107 leader_election.cc:288] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:37.250236 21112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:37.250437 21112 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [term 1 LEADER]: Becoming Leader. State: Replica: e3f97a0709ab422582fe9ebd36b4b5cb, State: Running, Role: LEADER
I20260811 14:25:37.250560 21112 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45423 } }
I20260811 14:25:37.250694 21107 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:37.251057 21113 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45423 } } }
I20260811 14:25:37.251163 21113 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:37.251060 21114 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f97a0709ab422582fe9ebd36b4b5cb. Latest consensus state: current_term: 1 leader_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f97a0709ab422582fe9ebd36b4b5cb" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45423 } } }
I20260811 14:25:37.251281 21114 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:37.252089 21117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:37.253252 21117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:37.256078 21117 catalog_manager.cc:1347] Generated new cluster ID: dfd7daae68a64596b4122be06172e73a
I20260811 14:25:37.256155 21117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:25:37.260710 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.241619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36718 (local address 127.20.132.254:45423)
0811 14:25:37.242026 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:37.242038 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:37.242191 (+ 153us) server_negotiation.cc:407] Connection header received
0811 14:25:37.244661 (+ 2470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:37.244667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:37.244813 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:37.244976 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:37.246537 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.248307 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.249577 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.250361 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.251931 (+ 1570us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.256125 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:37.256130 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:37.256130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:37.256142 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:37.258188 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.258645 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.258648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.258648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.258745 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.258978 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.258979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.258979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.259267 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:37.259406 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:37.260302 (+ 896us) server_negotiation.cc:299] Negotiation successful
0811 14:25:37.260466 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
I20260811 14:25:37.268602 21117 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:37.269160 21117 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:37.273361 21117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3f97a0709ab422582fe9ebd36b4b5cb: Generated new TSK 0
I20260811 14:25:37.273545 21117 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:37.303665 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45423
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:37.395938 21134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:37.396220 21134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:37.396270 21134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:37.397554 21134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:37.397634 21134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:37.397686 21134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:37.399295 21134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45423
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:37.399655 21134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:37.399917 21134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:37.405769 21142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:37.405786 21143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:37.405777 21145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:37.406376 21134 server_base.cc:1034] running on GCE node
I20260811 14:25:37.406633 21134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:37.406909 21134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:37.408125 21134 hybrid_clock.cc:648] HybridClock initialized: now 1786458337408095 us; error 48 us; skew 500 ppm
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:37.411245 21134 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:37.412009 21134 webserver.cc:460] Webserver started at http://127.20.132.193:44539/ using document root <none> and password file <none>
I20260811 14:25:37.412339 21134 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:37.412425 21134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:37.412561 21134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:37.413601 21134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "48b760e338494b3b863d3b6d9e38448f"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "d4ac0a7ffd53575a6b5bbb7f049b92ae"
server_key_iv: "e5441e3facfe201567a77dd01198b9c0"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.413990 21134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "48b760e338494b3b863d3b6d9e38448f"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "d4ac0a7ffd53575a6b5bbb7f049b92ae"
server_key_iv: "e5441e3facfe201567a77dd01198b9c0"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.415441 21134 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:37.416307 21152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.416494 21134 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:25:37.416594 21134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "48b760e338494b3b863d3b6d9e38448f"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "d4ac0a7ffd53575a6b5bbb7f049b92ae"
server_key_iv: "e5441e3facfe201567a77dd01198b9c0"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.416683 21134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:37.433658 21134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:37.435926 21134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:37.436106 21134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:37.436460 21134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:37.436861 21134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:37.436964 21134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.437008 21134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:37.437031 21134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.443554 21134 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:36441
I20260811 14:25:37.443642 21278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:36441 every 8 connection(s)
I20260811 14:25:37.443979 21134 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:25:37.449602 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21134
I20260811 14:25:37.449694 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:37.449873 21011 external_mini_cluster.cc:1428] Setting key fe862055d7797d70417191552eb1b884
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:37.454779 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.444922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:34803 (local address 127.20.132.254:45423)
0811 14:25:37.444976 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:37.445000 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:37.445231 (+ 231us) server_negotiation.cc:407] Connection header received
0811 14:25:37.445778 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:37.445779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:37.445793 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:37.445855 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:37.446985 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.447499 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.448560 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.448786 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.448883 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.451498 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:37.451500 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:37.451500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:37.451509 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:37.453181 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.453717 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.453718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.453718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.453771 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.454069 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.454069 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.454070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.454212 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:37.454269 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:37.454638 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 14:25:37.454712 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 14:25:37.455116 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.444876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45423 (local address 127.20.132.193:34803)
0811 14:25:37.445070 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:37.445115 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:37.445662 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:37.445926 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:37.445931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:37.446657 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:37.446858 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:37.446862 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.447607 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.447608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:37.448453 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:37.448456 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.448894 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.448895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:37.449037 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.449643 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:37.449652 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:37.451399 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:37.453270 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:37.453278 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:37.453281 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:37.453627 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:37.453842 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:37.453843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:37.453844 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:37.453996 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:37.454287 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:37.454294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:37.454493 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 14:25:37.454615 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 14:25:37.454812 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260811 14:25:37.455746 21279 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45423
I20260811 14:25:37.455866 21279 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:37.456063 21279 heartbeater.cc:511] Master 127.20.132.254:45423 requested a full tablet report, sending...
I20260811 14:25:37.457185 21069 ts_manager.cc:194] Registered new tserver with Master: 48b760e338494b3b863d3b6d9e38448f (127.20.132.193:36441)
I20260811 14:25:37.458345 21069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:34803
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:37.480878 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45423
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:37.565697 21285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:37.565910 21285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:37.565934 21285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:37.567097 21285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:37.567153 21285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:37.567183 21285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:37.568673 21285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45423
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:37.568903 21285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:37.569160 21285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:37.574594 21293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:37.574661 21285 server_base.cc:1034] running on GCE node
W20260811 14:25:37.574676 21290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:37.574609 21291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:37.575017 21285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:37.575296 21285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:37.576470 21285 hybrid_clock.cc:648] HybridClock initialized: now 1786458337576454 us; error 27 us; skew 500 ppm
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:37.578938 21285 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:37.579370 21285 webserver.cc:460] Webserver started at http://127.20.132.194:41401/ using document root <none> and password file <none>
I20260811 14:25:37.579602 21285 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:37.579684 21285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:37.579843 21285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:37.581041 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "8d8eb6debd504f62b2367e73f4aa7626"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "382b64785389fa135ea7a945cda9c98e"
server_key_iv: "5b85f933c3eecc2674ec56139123df67"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.581511 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "8d8eb6debd504f62b2367e73f4aa7626"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "382b64785389fa135ea7a945cda9c98e"
server_key_iv: "5b85f933c3eecc2674ec56139123df67"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.582983 21285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:37.583822 21301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.584014 21285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:37.584120 21285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "8d8eb6debd504f62b2367e73f4aa7626"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "382b64785389fa135ea7a945cda9c98e"
server_key_iv: "5b85f933c3eecc2674ec56139123df67"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.584209 21285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:37.607743 21285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:37.610026 21285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:37.610209 21285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:37.610478 21285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:37.610805 21285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:37.610864 21285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.610908 21285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:37.610935 21285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.617492 21285 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:46575
I20260811 14:25:37.617559 21430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:46575 every 8 connection(s)
I20260811 14:25:37.617879 21285 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:37.627038 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21285
I20260811 14:25:37.627132 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:37.627265 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.618701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:47233 (local address 127.20.132.254:45423)
0811 14:25:37.618764 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:37.618766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:37.618974 (+ 208us) server_negotiation.cc:407] Connection header received
0811 14:25:37.619561 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:37.619562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:37.619573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:37.619640 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:37.620696 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.621218 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.622184 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.622372 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.622433 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.624533 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:37.624534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:37.624535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:37.624541 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:37.625981 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.626332 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.626332 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.626333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.626382 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.626599 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.626599 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.626600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.626698 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:37.626749 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:37.627063 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 14:25:37.627187 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:25:37.627316 21011 external_mini_cluster.cc:1428] Setting key 12014e5279a3d039748d836fe783e3a4
I20260811 14:25:37.627450 21434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.618676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45423 (local address 127.20.132.194:47233)
0811 14:25:37.618845 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:37.618886 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:37.619471 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:37.619701 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:37.619704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:37.620387 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:37.620606 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:37.620610 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.621324 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.621325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:37.622103 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:37.622105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.622455 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.622455 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:37.622553 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.623015 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:37.623023 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:37.624434 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:37.626056 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:37.626061 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:37.626062 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:37.626264 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:37.626447 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:37.626448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:37.626448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:37.626541 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:37.626756 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:37.626760 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:37.626918 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 14:25:37.627044 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 14:25:37.627215 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":80,"threads_started":1}
I20260811 14:25:37.627969 21431 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45423
I20260811 14:25:37.628073 21431 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:37.628293 21431 heartbeater.cc:511] Master 127.20.132.254:45423 requested a full tablet report, sending...
I20260811 14:25:37.628743 21069 ts_manager.cc:194] Registered new tserver with Master: 8d8eb6debd504f62b2367e73f4aa7626 (127.20.132.194:46575)
I20260811 14:25:37.629240 21069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:47233
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:37.655467 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45423
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:37.738751 21437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:37.738972 21437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:37.738999 21437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:37.740149 21437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:37.740228 21437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:37.740268 21437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:37.741714 21437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45423
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:37.741930 21437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:37.742122 21437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:37.747296 21442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:37.747403 21443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:37.747308 21445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:37.747581 21437 server_base.cc:1034] running on GCE node
I20260811 14:25:37.747795 21437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:37.748054 21437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:37.749259 21437 hybrid_clock.cc:648] HybridClock initialized: now 1786458337749233 us; error 45 us; skew 500 ppm
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:37.751952 21437 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:37.752442 21437 webserver.cc:460] Webserver started at http://127.20.132.195:34849/ using document root <none> and password file <none>
I20260811 14:25:37.752707 21437 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:37.752779 21437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:37.752933 21437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:37.754011 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "69cb32c40ed74eb8ae4811b15d8992bb"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "bf442d4f2deabb923de5321e7ac153fa"
server_key_iv: "b7782242d8d2a60549e90b7dc69bc457"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.754396 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "69cb32c40ed74eb8ae4811b15d8992bb"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "bf442d4f2deabb923de5321e7ac153fa"
server_key_iv: "b7782242d8d2a60549e90b7dc69bc457"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.755832 21437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:37.756961 21452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.757206 21437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:37.757305 21437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "69cb32c40ed74eb8ae4811b15d8992bb"
format_stamp: "Formatted at 2026-08-11 14:25:37 on dist-test-slave-cbbz"
server_key: "bf442d4f2deabb923de5321e7ac153fa"
server_key_iv: "b7782242d8d2a60549e90b7dc69bc457"
server_key_version: "encryptionkey@0"
I20260811 14:25:37.757365 21437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:37.773631 21437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:37.775616 21437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:37.775740 21437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:37.775940 21437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:37.776379 21437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:37.776427 21437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.776450 21437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:37.776465 21437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:37.784412 21437 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43803
I20260811 14:25:37.784452 21577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43803 every 8 connection(s)
I20260811 14:25:37.784821 21437 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:37.790961 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21437
I20260811 14:25:37.791065 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:37.791231 21011 external_mini_cluster.cc:1428] Setting key 956e076507c091b817cf183450eb79d0
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:37.794934 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.785672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:37317 (local address 127.20.132.254:45423)
0811 14:25:37.785719 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:37.785721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:37.785959 (+ 238us) server_negotiation.cc:407] Connection header received
0811 14:25:37.786508 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:37.786509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:37.786518 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:37.786575 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:37.787669 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.788324 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.789410 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.789589 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.789650 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.792242 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:37.792244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:37.792244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:37.792253 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:37.793733 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.794115 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.794116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.794116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.794171 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.794395 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.794395 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.794396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.794507 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:37.794571 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:37.794798 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 14:25:37.794862 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:25:37.795091 21580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.785631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45423 (local address 127.20.132.195:37317)
0811 14:25:37.785813 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:37.785861 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:37.786416 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:37.786641 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:37.786645 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:37.787354 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:37.787578 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:37.787583 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.788414 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.788414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:37.789325 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:37.789328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.789678 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.789679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:37.789783 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.790303 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:37.790312 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:37.792125 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:37.793809 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:37.793815 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:37.793817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:37.794042 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:37.794235 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:37.794235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:37.794236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:37.794335 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:37.794565 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:37.794569 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:37.794686 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 14:25:37.794766 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:25:37.794886 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
I20260811 14:25:37.795643 21578 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45423
I20260811 14:25:37.795725 21578 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:37.795925 21578 heartbeater.cc:511] Master 127.20.132.254:45423 requested a full tablet report, sending...
I20260811 14:25:37.796362 21069 ts_manager.cc:194] Registered new tserver with Master: 69cb32c40ed74eb8ae4811b15d8992bb (127.20.132.195:43803)
I20260811 14:25:37.796783 21069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:37317
I20260811 14:25:37.803610 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:37.827874 21585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.820193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58646 (local address 127.20.132.193:36441)
0811 14:25:37.820408 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:37.820413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:37.820426 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:25:37.820475 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:37.820477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:37.820493 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:37.820562 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:37.821121 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.821860 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.822549 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.822872 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.822927 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.825255 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:37.825263 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:37.825264 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:37.825270 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:37.826657 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.826974 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.826976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.826977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.827031 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.827218 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.827219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.827219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.827344 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:37.827446 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:37.827610 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 14:25:37.827729 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":114,"threads_started":1}
W20260811 14:25:37.828447 21183 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58646
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:37.852602 21585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:37.845115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58658 (local address 127.20.132.193:36441)
0811 14:25:37.845301 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:37.845304 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:37.845319 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:25:37.845343 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:37.845344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:37.845356 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:37.845407 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:37.845951 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.846452 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.847149 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:37.847347 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:37.847398 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:37.849602 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:37.849603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:37.849604 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:37.849613 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:37.851365 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.851761 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.851762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.851763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.851819 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:37.852065 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:37.852065 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:37.852065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:37.852235 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:37.852337 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:37.852414 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 14:25:37.852477 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260811 14:25:37.853173 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21134
I20260811 14:25:37.861120 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21285
I20260811 14:25:37.867991 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21437
I20260811 14:25:37.874496 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21033
2026-08-11T14:25:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2034 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21595](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21595](info): set up 2 sockets
Aug 11 14:25:37 dist-test-slave-cbbz krb5kdc[21595](info): commencing operation
krb5kdc: starting...
W20260811 14:25:38.999539 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:39.127825 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34453
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:34453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:39.210212 21610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:39.210446 21610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:39.210485 21610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:39.211619 21610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:39.211692 21610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:39.211717 21610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:39.211746 21610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:39.211778 21610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:39.213231 21610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:34453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:39.213506 21610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:39.213748 21610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:39.218572 21616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.218582 21617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.218701 21619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:39.218926 21610 server_base.cc:1034] running on GCE node
I20260811 14:25:39.219162 21610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:39.219391 21610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:39.220530 21610 hybrid_clock.cc:648] HybridClock initialized: now 1786458339220517 us; error 29 us; skew 500 ppm
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:39.223153 21610 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:39.223609 21610 webserver.cc:460] Webserver started at http://127.20.132.254:38141/ using document root <none> and password file <none>
I20260811 14:25:39.223851 21610 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:39.223896 21610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:39.224049 21610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:39.225082 21610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "8a709f5c831d433fac684359e92d85b7"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "c1b6962e379fd7b6d4b264df4645a49f"
server_key_iv: "235e94bc094665e01b8830c415dff27c"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.225451 21610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "8a709f5c831d433fac684359e92d85b7"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "c1b6962e379fd7b6d4b264df4645a49f"
server_key_iv: "235e94bc094665e01b8830c415dff27c"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.226783 21610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:25:39.227586 21627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.227814 21610 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:39.227917 21610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8a709f5c831d433fac684359e92d85b7"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "c1b6962e379fd7b6d4b264df4645a49f"
server_key_iv: "235e94bc094665e01b8830c415dff27c"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.227999 21610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:39.237749 21610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:39.239528 21610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:39.239699 21610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:39.243680 21610 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:34453
I20260811 14:25:39.243718 21684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:34453 every 8 connection(s)
I20260811 14:25:39.244043 21610 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:39.244912 21685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:39.247041 21685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7: Bootstrap starting.
I20260811 14:25:39.247553 21685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:39.247779 21685 log.cc:824] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:39.248469 21685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7: No bootstrap required, opened a new log
I20260811 14:25:39.249963 21685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a709f5c831d433fac684359e92d85b7" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34453 } }
I20260811 14:25:39.250094 21685 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:39.250116 21685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a709f5c831d433fac684359e92d85b7, State: Initialized, Role: FOLLOWER
I20260811 14:25:39.250222 21685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a709f5c831d433fac684359e92d85b7" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34453 } }
I20260811 14:25:39.250309 21685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:39.250344 21685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:39.250397 21685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:39.250905 21685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a709f5c831d433fac684359e92d85b7" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34453 } }
I20260811 14:25:39.251030 21685 leader_election.cc:302] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a709f5c831d433fac684359e92d85b7; no voters:
I20260811 14:25:39.251214 21685 leader_election.cc:288] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:39.251282 21688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:39.251583 21688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [term 1 LEADER]: Becoming Leader. State: Replica: 8a709f5c831d433fac684359e92d85b7, State: Running, Role: LEADER
I20260811 14:25:39.251613 21685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:39.251720 21688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a709f5c831d433fac684359e92d85b7" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34453 } }
I20260811 14:25:39.252425 21689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a709f5c831d433fac684359e92d85b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a709f5c831d433fac684359e92d85b7" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34453 } } }
I20260811 14:25:39.252537 21689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:39.252465 21690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a709f5c831d433fac684359e92d85b7. Latest consensus state: current_term: 1 leader_uuid: "8a709f5c831d433fac684359e92d85b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a709f5c831d433fac684359e92d85b7" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34453 } } }
I20260811 14:25:39.252785 21690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:39.252799 21699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:39.253067 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21610
I20260811 14:25:39.253180 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:39.253382 21011 external_mini_cluster.cc:1428] Setting key eb9cbc041db5fd9cfe984ef56c6f8eb5
I20260811 14:25:39.253479 21699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:39.255535 21699 catalog_manager.cc:1347] Generated new cluster ID: 6e6e30996df14a8cb1dcd263f4f1565d
I20260811 14:25:39.255601 21699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:39.265872 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.254058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.20.132.254:34453)
0811 14:25:39.254261 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.254271 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.254305 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:25:39.254425 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.254432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.254490 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.254668 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:39.255496 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.257108 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.258213 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.258857 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.258964 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.262046 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:39.262051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:39.262051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:39.262063 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:39.264184 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.264595 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.264598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.264598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.264712 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.264942 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.264943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.264943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.265238 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:39.265389 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.265498 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.265631 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":89,"threads_started":1}
I20260811 14:25:39.279739 21699 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:39.280340 21699 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:39.285125 21699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a709f5c831d433fac684359e92d85b7: Generated new TSK 0
I20260811 14:25:39.285302 21699 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:39.316272 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34453
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:39.399407 21714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:39.399621 21714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:39.399645 21714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:39.400835 21714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:39.400884 21714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:39.400913 21714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:39.402364 21714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34453
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:39.402554 21714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:39.402731 21714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:39.407819 21723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.407925 21721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.407824 21720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:39.408056 21714 server_base.cc:1034] running on GCE node
I20260811 14:25:39.408317 21714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:39.408612 21714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:39.409799 21714 hybrid_clock.cc:648] HybridClock initialized: now 1786458339409783 us; error 28 us; skew 500 ppm
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:39.412782 21714 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:39.413226 21714 webserver.cc:460] Webserver started at http://127.20.132.193:43685/ using document root <none> and password file <none>
I20260811 14:25:39.413457 21714 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:39.413545 21714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:39.413702 21714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:39.414781 21714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "c790597fc3814103bbb700e14fd7f858"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "14c4330bed1b94fb1095e6708c9abc84"
server_key_iv: "d6325b9206a8616c58d1fee81aa7d751"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.415184 21714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "c790597fc3814103bbb700e14fd7f858"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "14c4330bed1b94fb1095e6708c9abc84"
server_key_iv: "d6325b9206a8616c58d1fee81aa7d751"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.416607 21714 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:39.417382 21732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.417564 21714 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:39.417670 21714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "c790597fc3814103bbb700e14fd7f858"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "14c4330bed1b94fb1095e6708c9abc84"
server_key_iv: "d6325b9206a8616c58d1fee81aa7d751"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.417755 21714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:39.428452 21714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:39.430714 21714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:39.430881 21714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:39.431159 21714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:39.431538 21714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:39.431603 21714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.431648 21714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:39.431674 21714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.438002 21714 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:33485
I20260811 14:25:39.438058 21859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:33485 every 8 connection(s)
I20260811 14:25:39.438377 21714 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:25:39.441573 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21714
I20260811 14:25:39.441700 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:39.441882 21011 external_mini_cluster.cc:1428] Setting key 3eee1921c731bed13abfcc5aa6b096ae
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:39.448948 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.439134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:39761 (local address 127.20.132.254:34453)
0811 14:25:39.439225 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.439228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.439399 (+ 171us) server_negotiation.cc:407] Connection header received
0811 14:25:39.440464 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.440465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.440475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.440528 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:39.441147 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.441664 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.443023 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.443390 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.443465 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.445718 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:39.445720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:39.445721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:39.445728 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:39.447493 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.447892 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.447894 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.447894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.447965 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.448287 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.448288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.448289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.448410 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:39.448495 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.448770 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.448859 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 14:25:39.449160 21863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.439081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34453 (local address 127.20.132.193:39761)
0811 14:25:39.439277 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:39.439314 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:39.440370 (+ 1056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:39.440590 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:39.440593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:39.440850 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:39.441041 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.441044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.441849 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.441850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.442928 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.442931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.443489 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.443490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.443605 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.444228 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:39.444236 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:39.445624 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:39.447582 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:39.447588 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:39.447590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:39.447810 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:39.448040 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:39.448041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:39.448041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:39.448207 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:39.448485 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:39.448492 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:39.448627 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 14:25:39.448734 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 14:25:39.448891 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
I20260811 14:25:39.449656 21861 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34453
I20260811 14:25:39.449776 21861 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:39.449992 21861 heartbeater.cc:511] Master 127.20.132.254:34453 requested a full tablet report, sending...
I20260811 14:25:39.450505 21644 ts_manager.cc:194] Registered new tserver with Master: c790597fc3814103bbb700e14fd7f858 (127.20.132.193:33485)
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
I20260811 14:25:39.451200 21644 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:39761
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:39.469107 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34453
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:39.551050 21866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:39.551244 21866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:39.551270 21866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:39.552599 21866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:39.552644 21866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:39.552670 21866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:39.554172 21866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34453
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:39.554352 21866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:39.554525 21866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:39.559522 21871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.559520 21872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.559520 21875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:39.559803 21866 server_base.cc:1034] running on GCE node
I20260811 14:25:39.559993 21866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:39.560276 21866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:39.561431 21866 hybrid_clock.cc:648] HybridClock initialized: now 1786458339561421 us; error 28 us; skew 500 ppm
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:39.563947 21866 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:39.564459 21866 webserver.cc:460] Webserver started at http://127.20.132.194:36611/ using document root <none> and password file <none>
I20260811 14:25:39.564689 21866 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:39.564734 21866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:39.564889 21866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:39.565951 21866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "50e3bef7cfb44241983a29dcd5e64ae2"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "728876d5ea0ccc86a3aa547e747da428"
server_key_iv: "816d96ea4e07b01bc0f749e036b5913e"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.566320 21866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "50e3bef7cfb44241983a29dcd5e64ae2"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "728876d5ea0ccc86a3aa547e747da428"
server_key_iv: "816d96ea4e07b01bc0f749e036b5913e"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.567615 21866 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:39.568360 21883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.568538 21866 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:39.568655 21866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "50e3bef7cfb44241983a29dcd5e64ae2"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "728876d5ea0ccc86a3aa547e747da428"
server_key_iv: "816d96ea4e07b01bc0f749e036b5913e"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.568732 21866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:39.583218 21866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:39.585103 21866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:39.585271 21866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:39.585506 21866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:39.585824 21866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:39.585881 21866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.585914 21866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:39.585942 21866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.591976 21866 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:37153
I20260811 14:25:39.592016 22008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:37153 every 8 connection(s)
I20260811 14:25:39.592408 21866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:39.594135 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 21866
I20260811 14:25:39.594238 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:39.594430 21011 external_mini_cluster.cc:1428] Setting key 58a25cffc026e6ac89807e545e578e02
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:39.603067 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.593189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:43315 (local address 127.20.132.254:34453)
0811 14:25:39.593254 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.593256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.593455 (+ 199us) server_negotiation.cc:407] Connection header received
0811 14:25:39.594642 (+ 1187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.594644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.594661 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.594723 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:39.595481 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.595966 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.597345 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.597534 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.597593 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.600075 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:39.600077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:39.600077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:39.600084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:39.601606 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.602071 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.602072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.602073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.602135 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.602402 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.602403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.602403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.602527 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:39.602620 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.602892 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.602979 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:25:39.603257 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.593164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34453 (local address 127.20.132.194:43315)
0811 14:25:39.593340 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:39.593374 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:39.594543 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:39.594809 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:39.594813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:39.595071 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:39.595357 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.595363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.596064 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.596065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.597262 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.597265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.597632 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.597633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.597789 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.598367 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:39.598378 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:39.599959 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:39.601713 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:39.601720 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:39.601722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:39.601985 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:39.602213 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:39.602214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:39.602214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:39.602322 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:39.602603 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:39.602610 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:39.602751 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 14:25:39.602858 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 14:25:39.603014 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
I20260811 14:25:39.603775 22009 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34453
I20260811 14:25:39.603879 22009 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:39.604071 22009 heartbeater.cc:511] Master 127.20.132.254:34453 requested a full tablet report, sending...
I20260811 14:25:39.604518 21644 ts_manager.cc:194] Registered new tserver with Master: 50e3bef7cfb44241983a29dcd5e64ae2 (127.20.132.194:37153)
I20260811 14:25:39.604876 21644 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:43315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:39.623311 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34453
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:39.706005 22015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:39.706212 22015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:39.706236 22015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:39.707301 22015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:39.707336 22015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:39.707362 22015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:39.708876 22015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34453
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:39.709061 22015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:39.709235 22015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:39.714633 22021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:39.714713 22015 server_base.cc:1034] running on GCE node
W20260811 14:25:39.714681 22020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:39.714689 22023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:39.715055 22015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:39.715291 22015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:39.716447 22015 hybrid_clock.cc:648] HybridClock initialized: now 1786458339716434 us; error 27 us; skew 500 ppm
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:39.719100 22015 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:39.719551 22015 webserver.cc:460] Webserver started at http://127.20.132.195:40889/ using document root <none> and password file <none>
I20260811 14:25:39.719789 22015 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:39.719837 22015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:39.719995 22015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:39.721138 22015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "9799e534518144f2bd255143973fdda9"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "9ef831d4b096e2b2b82d6b8cfd7fdb38"
server_key_iv: "976b96e6a9c603c4fa05d8380831344b"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.721516 22015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "9799e534518144f2bd255143973fdda9"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "9ef831d4b096e2b2b82d6b8cfd7fdb38"
server_key_iv: "976b96e6a9c603c4fa05d8380831344b"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.722855 22015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:25:39.723548 22030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.723728 22015 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:39.723811 22015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "9799e534518144f2bd255143973fdda9"
format_stamp: "Formatted at 2026-08-11 14:25:39 on dist-test-slave-cbbz"
server_key: "9ef831d4b096e2b2b82d6b8cfd7fdb38"
server_key_iv: "976b96e6a9c603c4fa05d8380831344b"
server_key_version: "encryptionkey@0"
I20260811 14:25:39.723865 22015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:39.744971 22015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:39.746913 22015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:39.747027 22015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:39.747236 22015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:39.747577 22015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:39.747611 22015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.747635 22015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:39.747687 22015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:39.754504 22015 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:41511
I20260811 14:25:39.754565 22159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:41511 every 8 connection(s)
I20260811 14:25:39.754909 22015 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:39.758497 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 22015
I20260811 14:25:39.758616 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:39.758841 21011 external_mini_cluster.cc:1428] Setting key b4d21bfe9abcc898920741a6d755f112
Aug 11 14:25:39 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:39.765280 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.755692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:53437 (local address 127.20.132.254:34453)
0811 14:25:39.755772 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.755773 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.755963 (+ 190us) server_negotiation.cc:407] Connection header received
0811 14:25:39.757051 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.757053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.757068 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.757119 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:39.757818 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.758331 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.759834 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.760088 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.760206 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.762476 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:39.762477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:39.762477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:39.762484 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:39.763873 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.764350 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.764351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.764351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.764409 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.764640 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.764640 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.764641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.764808 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:39.764862 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.765148 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.765213 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:25:39.765421 22162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.755655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34453 (local address 127.20.132.195:53437)
0811 14:25:39.755837 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:39.755875 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:39.756925 (+ 1050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:39.757194 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:39.757197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:39.757469 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:39.757668 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.757672 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.758476 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.758477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.759744 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.759757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.760208 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.760209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.760333 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.760894 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:39.760902 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:39.762382 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:39.763956 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:39.763963 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:39.763965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:39.764281 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:39.764471 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:39.764472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:39.764472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:39.764575 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:39.764878 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:39.764883 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:39.765003 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 14:25:39.765087 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:25:39.765212 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":74,"threads_started":1}
I20260811 14:25:39.765987 22160 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34453
I20260811 14:25:39.766083 22160 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:39.766229 22160 heartbeater.cc:511] Master 127.20.132.254:34453 requested a full tablet report, sending...
I20260811 14:25:39.766594 21644 ts_manager.cc:194] Registered new tserver with Master: 9799e534518144f2bd255143973fdda9 (127.20.132.195:41511)
I20260811 14:25:39.766945 21644 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:53437
I20260811 14:25:39.770955 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:25:39.779285 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.773214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56744 (local address 127.20.132.254:34453)
0811 14:25:39.773295 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.773297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.773343 (+ 46us) server_negotiation.cc:407] Connection header received
0811 14:25:39.773377 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.773378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.773386 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.773440 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:39.773962 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.774502 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.775191 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.775385 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.775440 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.776749 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:39.776750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:39.776750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:39.776757 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:39.778178 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.778489 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.778490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.778490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.778541 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:39.778713 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:39.778713 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:39.778713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:39.778849 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:39.778924 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.779037 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.779125 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:25:39.782226 21644 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:39.784047 21644 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:39.791492 22171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.787193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:33485 (local address 127.0.0.1:42178)
0811 14:25:39.787447 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:39.787460 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:39.787519 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:39.788032 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:39.788033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:39.788035 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:39.788111 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.788113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.789166 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.789168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.790478 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.790481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.791193 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.791194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.791273 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.791286 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 14:25:39.791355 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:25:39.791411 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":52,"threads_started":1}
I20260811 14:25:39.791501 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.787318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42178 (local address 127.20.132.193:33485)
0811 14:25:39.787739 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.787744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.787754 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:39.787794 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.787796 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.787811 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.788027 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:39.788280 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.789052 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.790584 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.791092 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.791194 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.791255 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.791384 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.791424 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":122,"threads_started":1}
I20260811 14:25:39.791827 22168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.786936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:41511 (local address 127.0.0.1:35714)
0811 14:25:39.787079 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:39.787123 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:39.787199 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:39.787711 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:39.787714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:39.787717 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:39.787791 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.787792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.789381 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.789382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.790512 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.790514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.791508 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.791510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.791602 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.791608 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 14:25:39.791672 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:25:39.791724 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":43,"thread_start_us":67,"threads_started":1}
I20260811 14:25:39.792068 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.787497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37894 (local address 127.20.132.194:37153)
0811 14:25:39.787706 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.787711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.787721 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:39.787765 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.787768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.787784 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.787867 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:39.788101 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.789304 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.790514 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.791318 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.791406 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.791465 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.791851 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.791989 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":111,"threads_started":1}
I20260811 14:25:39.792110 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.787077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35714 (local address 127.20.132.195:41511)
0811 14:25:39.787525 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:39.787531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:39.787544 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:25:39.787594 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:39.787596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:39.787613 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:39.787718 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:39.787854 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.789250 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.790599 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.791351 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.791418 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.791466 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:39.791980 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 14:25:39.792032 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":98,"threads_started":1}
I20260811 14:25:39.792430 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:39.787340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37153 (local address 127.0.0.1:37894)
0811 14:25:39.787533 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:39.787545 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:39.787602 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:39.787966 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:39.787967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:39.787969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:39.788013 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.788015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.789432 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.789433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.790443 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:39.790447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:39.791510 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:39.791511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:39.791742 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:39.791746 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:39.791806 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 14:25:39.791842 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":3,"thread_start_us":68,"threads_started":1}
I20260811 14:25:39.792557 21785 tablet_service.cc:1467] Processing CreateTablet for tablet 1fa98d7a0c384ff899bb5d410d7c30e1 (DEFAULT_TABLE table=test-table [id=0c6fc7f34ddc45908fe3177069b68865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:39.792972 21785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fa98d7a0c384ff899bb5d410d7c30e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:39.793166 21938 tablet_service.cc:1467] Processing CreateTablet for tablet 1fa98d7a0c384ff899bb5d410d7c30e1 (DEFAULT_TABLE table=test-table [id=0c6fc7f34ddc45908fe3177069b68865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:39.793497 21938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fa98d7a0c384ff899bb5d410d7c30e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:39.796795 22175 tablet_bootstrap.cc:492] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: Bootstrap starting.
I20260811 14:25:39.796958 22176 tablet_bootstrap.cc:492] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: Bootstrap starting.
I20260811 14:25:39.796902 22085 tablet_service.cc:1467] Processing CreateTablet for tablet 1fa98d7a0c384ff899bb5d410d7c30e1 (DEFAULT_TABLE table=test-table [id=0c6fc7f34ddc45908fe3177069b68865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:39.797315 22085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fa98d7a0c384ff899bb5d410d7c30e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:39.797586 22176 tablet_bootstrap.cc:654] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:39.797624 22175 tablet_bootstrap.cc:654] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:39.798264 22176 log.cc:824] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:39.798312 22175 log.cc:824] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:39.799118 22176 tablet_bootstrap.cc:492] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: No bootstrap required, opened a new log
I20260811 14:25:39.799193 22176 ts_tablet_manager.cc:1397] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:25:39.800747 22180 tablet_bootstrap.cc:492] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: Bootstrap starting.
I20260811 14:25:39.801003 22175 tablet_bootstrap.cc:492] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: No bootstrap required, opened a new log
I20260811 14:25:39.801065 22175 ts_tablet_manager.cc:1397] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 14:25:39.801050 22176 raft_consensus.cc:348] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:39.801234 22176 raft_consensus.cc:374] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:39.801268 22176 raft_consensus.cc:729] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e3bef7cfb44241983a29dcd5e64ae2, State: Initialized, Role: FOLLOWER
I20260811 14:25:39.801355 22180 tablet_bootstrap.cc:654] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:39.801406 22176 consensus_queue.cc:260] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:39.801687 22176 ts_tablet_manager.cc:1428] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 14:25:39.801870 22009 heartbeater.cc:503] Master 127.20.132.254:34453 was elected leader, sending a full tablet report...
I20260811 14:25:39.801991 22180 log.cc:824] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:39.802824 22180 tablet_bootstrap.cc:492] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: No bootstrap required, opened a new log
I20260811 14:25:39.802884 22180 ts_tablet_manager.cc:1397] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:25:39.803316 22175 raft_consensus.cc:348] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:39.803476 22175 raft_consensus.cc:374] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:39.803510 22175 raft_consensus.cc:729] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c790597fc3814103bbb700e14fd7f858, State: Initialized, Role: FOLLOWER
I20260811 14:25:39.803629 22175 consensus_queue.cc:260] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:39.803907 22175 ts_tablet_manager.cc:1428] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:25:39.803946 21861 heartbeater.cc:503] Master 127.20.132.254:34453 was elected leader, sending a full tablet report...
I20260811 14:25:39.805024 22180 raft_consensus.cc:348] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:39.805238 22180 raft_consensus.cc:374] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:39.805291 22180 raft_consensus.cc:729] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9799e534518144f2bd255143973fdda9, State: Initialized, Role: FOLLOWER
I20260811 14:25:39.805401 22180 consensus_queue.cc:260] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:39.805680 22180 ts_tablet_manager.cc:1428] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:25:39.805696 22160 heartbeater.cc:503] Master 127.20.132.254:34453 was elected leader, sending a full tablet report...
W20260811 14:25:39.843065 22010 tablet.cc:2369] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:25:39.939136 21862 tablet.cc:2369] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:25:40.005564 22161 tablet.cc:2369] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:25:40.024210 22185 raft_consensus.cc:482] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:40.024354 22185 raft_consensus.cc:504] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:40.024977 22185 leader_election.cc:288] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c790597fc3814103bbb700e14fd7f858 (127.20.132.193:33485), 50e3bef7cfb44241983a29dcd5e64ae2 (127.20.132.194:37153)
I20260811 14:25:40.028487 22162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.025239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:33485 (local address 127.20.132.195:49693)
0811 14:25:40.025306 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:40.025319 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:40.025367 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:40.025557 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:40.025566 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:40.025567 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:40.025644 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:40.025646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.026460 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.026461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:40.027459 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:40.027462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.028173 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.028174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:40.028262 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.028266 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:40.028344 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:25:40.028396 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":2}
I20260811 14:25:40.028501 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.025322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:49693 (local address 127.20.132.193:33485)
0811 14:25:40.025408 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:40.025411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:40.025424 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:25:40.025459 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:40.025461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:40.025471 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:40.025550 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:40.025767 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.026380 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.027559 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.028050 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.028110 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.028118 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:40.028358 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 14:25:40.028424 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 14:25:40.028787 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.025492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:42689 (local address 127.20.132.194:37153)
0811 14:25:40.025542 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:40.025544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:40.025713 (+ 169us) server_negotiation.cc:407] Connection header received
0811 14:25:40.025744 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:40.025764 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:40.025775 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:40.025821 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:40.025976 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.026524 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.027790 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.028340 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.028413 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.028421 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:40.028657 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 14:25:40.028707 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 14:25:40.029057 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.025377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37153 (local address 127.20.132.195:42689)
0811 14:25:40.025597 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:40.025616 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:40.025676 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:40.025827 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:40.025828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:40.025829 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:40.025902 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:40.025904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.026634 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.026635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:40.027667 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:40.027669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.028431 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.028432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:40.028524 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.028529 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:25:40.028913 (+ 384us) client_negotiation.cc:240] Negotiation successful
0811 14:25:40.028977 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":115,"threads_started":1}
I20260811 14:25:40.029021 21808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa98d7a0c384ff899bb5d410d7c30e1" candidate_uuid: "9799e534518144f2bd255143973fdda9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c790597fc3814103bbb700e14fd7f858" is_pre_election: true
I20260811 14:25:40.029247 21808 raft_consensus.cc:2454] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9799e534518144f2bd255143973fdda9 in term 0.
I20260811 14:25:40.029485 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa98d7a0c384ff899bb5d410d7c30e1" candidate_uuid: "9799e534518144f2bd255143973fdda9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" is_pre_election: true
I20260811 14:25:40.029649 21960 raft_consensus.cc:2454] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9799e534518144f2bd255143973fdda9 in term 0.
I20260811 14:25:40.029659 22035 leader_election.cc:302] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9799e534518144f2bd255143973fdda9, c790597fc3814103bbb700e14fd7f858; no voters:
I20260811 14:25:40.029829 22185 raft_consensus.cc:2781] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:40.029910 22185 raft_consensus.cc:482] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:40.029940 22185 raft_consensus.cc:3037] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:40.030783 22185 raft_consensus.cc:504] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:40.030897 22185 leader_election.cc:288] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [CANDIDATE]: Term 1 election: Requested vote from peers c790597fc3814103bbb700e14fd7f858 (127.20.132.193:33485), 50e3bef7cfb44241983a29dcd5e64ae2 (127.20.132.194:37153)
I20260811 14:25:40.031138 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa98d7a0c384ff899bb5d410d7c30e1" candidate_uuid: "9799e534518144f2bd255143973fdda9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e3bef7cfb44241983a29dcd5e64ae2"
I20260811 14:25:40.031258 21808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa98d7a0c384ff899bb5d410d7c30e1" candidate_uuid: "9799e534518144f2bd255143973fdda9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c790597fc3814103bbb700e14fd7f858"
I20260811 14:25:40.031250 21960 raft_consensus.cc:3037] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:40.031337 21808 raft_consensus.cc:3037] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:40.032294 21960 raft_consensus.cc:2454] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 50e3bef7cfb44241983a29dcd5e64ae2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9799e534518144f2bd255143973fdda9 in term 1.
I20260811 14:25:40.032294 21808 raft_consensus.cc:2454] T 1fa98d7a0c384ff899bb5d410d7c30e1 P c790597fc3814103bbb700e14fd7f858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9799e534518144f2bd255143973fdda9 in term 1.
I20260811 14:25:40.032454 22035 leader_election.cc:302] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e3bef7cfb44241983a29dcd5e64ae2, 9799e534518144f2bd255143973fdda9; no voters:
I20260811 14:25:40.032548 22185 raft_consensus.cc:2781] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:40.032759 22185 raft_consensus.cc:686] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [term 1 LEADER]: Becoming Leader. State: Replica: 9799e534518144f2bd255143973fdda9, State: Running, Role: LEADER
I20260811 14:25:40.032884 22185 consensus_queue.cc:237] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } }
I20260811 14:25:40.034024 21644 catalog_manager.cc:5495] T 1fa98d7a0c384ff899bb5d410d7c30e1 P 9799e534518144f2bd255143973fdda9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9799e534518144f2bd255143973fdda9 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "9799e534518144f2bd255143973fdda9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9799e534518144f2bd255143973fdda9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c790597fc3814103bbb700e14fd7f858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e3bef7cfb44241983a29dcd5e64ae2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37153 } health_report { overall_health: UNKNOWN } } }
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:40.078516 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.070833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42186 (local address 127.20.132.193:33485)
0811 14:25:40.070963 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:40.070965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:40.071000 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:25:40.071024 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:40.071025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:40.071035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:40.071162 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:40.071757 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.072383 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.073064 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.073267 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.073320 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.075573 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:40.075584 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:40.075585 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:40.075591 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:40.077335 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:40.077690 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:40.077693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:40.077693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:40.077752 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:40.077938 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:40.077939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:40.077939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:40.078076 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:40.078215 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:40.078340 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 14:25:40.078400 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:40.102154 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.095327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42196 (local address 127.20.132.193:33485)
0811 14:25:40.095402 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:40.095404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:40.095446 (+ 42us) server_negotiation.cc:407] Connection header received
0811 14:25:40.095484 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:40.095485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:40.095493 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:40.095542 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:40.096060 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.096598 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.097318 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.097507 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.097596 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.099688 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:40.099689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:40.099690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:40.099697 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:40.100933 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:40.101309 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:40.101310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:40.101310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:40.101366 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:40.101566 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:40.101567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:40.101567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:40.101664 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:40.101788 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:40.101961 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 14:25:40.102041 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[21595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[21595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:40.125303 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:40.118259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42204 (local address 127.20.132.193:33485)
0811 14:25:40.118309 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:40.118311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:40.118372 (+ 61us) server_negotiation.cc:407] Connection header received
0811 14:25:40.118454 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:40.118455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:40.118464 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:40.118509 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:40.119064 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.119542 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.120463 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:40.120706 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:40.120790 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:40.123080 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:40.123081 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:40.123081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:40.123087 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:40.124293 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:40.124678 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:40.124679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:40.124679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:40.124728 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:40.124874 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:40.124875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:40.124875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:40.124957 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:40.125030 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:40.125181 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 14:25:40.125238 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 14:25:40.126020 21762 tablet_service.cc:2908] Rejecting scan request for tablet 1fa98d7a0c384ff899bb5d410d7c30e1: Uninitialized: clean time has not yet been initialized
I20260811 14:25:40.126989 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21714
I20260811 14:25:40.135111 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21866
I20260811 14:25:40.140499 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 22015
I20260811 14:25:40.146605 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 21610
2026-08-11T14:25:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2272 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[22202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[22202](info): set up 2 sockets
Aug 11 14:25:40 dist-test-slave-cbbz krb5kdc[22202](info): commencing operation
krb5kdc: starting...
W20260811 14:25:41.254602 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:41.377101 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45079
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:45079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:41.463318 22218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:41.463528 22218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:41.463551 22218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:41.464679 22218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:41.464715 22218 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 14:25:41.464728 22218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:41.464741 22218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:41.464754 22218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:41.464766 22218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:41.466334 22218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:45079
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:41.466537 22218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:41.466707 22218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:41.471803 22223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.471773 22226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.471787 22224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:41.472030 22218 server_base.cc:1034] running on GCE node
I20260811 14:25:41.472345 22218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:41.472672 22218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:41.473851 22218 hybrid_clock.cc:648] HybridClock initialized: now 1786458341473895 us; error 88 us; skew 500 ppm
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:41.480314 22218 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:41.480690 22218 webserver.cc:460] Webserver started at http://127.20.132.254:46507/ using document root <none> and password file <none>
I20260811 14:25:41.480938 22218 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:41.480984 22218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:41.481148 22218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:41.482226 22218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "5de9c5b7db524afdb73ac0e5b7c4b371"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "1e809bf1f86e389e1b470a9a9e032e45"
server_key_iv: "9b27c74f68269a640e54b0875f8646b0"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.482599 22218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "5de9c5b7db524afdb73ac0e5b7c4b371"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "1e809bf1f86e389e1b470a9a9e032e45"
server_key_iv: "9b27c74f68269a640e54b0875f8646b0"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.483904 22218 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:41.484750 22233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.484957 22218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:25:41.485031 22218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "5de9c5b7db524afdb73ac0e5b7c4b371"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "1e809bf1f86e389e1b470a9a9e032e45"
server_key_iv: "9b27c74f68269a640e54b0875f8646b0"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.485153 22218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:41.493290 22218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:41.495141 22218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:41.495302 22218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:41.500204 22218 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:45079
I20260811 14:25:41.500257 22299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:45079 every 8 connection(s)
I20260811 14:25:41.500579 22218 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:41.501216 22300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:41.502139 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 22218
I20260811 14:25:41.502245 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:41.502406 21011 external_mini_cluster.cc:1428] Setting key 34aab1dbd24412b4316d20b0b429046f
I20260811 14:25:41.504287 22300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: Bootstrap starting.
I20260811 14:25:41.505023 22300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:41.505347 22300 log.cc:824] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:41.506095 22300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: No bootstrap required, opened a new log
I20260811 14:25:41.508061 22300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45079 } }
I20260811 14:25:41.508270 22300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:41.508350 22300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de9c5b7db524afdb73ac0e5b7c4b371, State: Initialized, Role: FOLLOWER
I20260811 14:25:41.508771 22300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45079 } }
I20260811 14:25:41.508852 22300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:41.508875 22300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:41.508940 22300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:41.509483 22300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45079 } }
I20260811 14:25:41.509567 22300 leader_election.cc:302] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5de9c5b7db524afdb73ac0e5b7c4b371; no voters:
I20260811 14:25:41.509791 22300 leader_election.cc:288] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:41.509859 22305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:41.510012 22305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [term 1 LEADER]: Becoming Leader. State: Replica: 5de9c5b7db524afdb73ac0e5b7c4b371, State: Running, Role: LEADER
I20260811 14:25:41.510066 22300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:41.510118 22305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45079 } }
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:41.510471 22305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5de9c5b7db524afdb73ac0e5b7c4b371. Latest consensus state: current_term: 1 leader_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45079 } } }
I20260811 14:25:41.510541 22305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:41.510769 22313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:41.511262 22313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:41.511574 22307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de9c5b7db524afdb73ac0e5b7c4b371" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45079 } } }
I20260811 14:25:41.511689 22307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:41.514621 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.502928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38292 (local address 127.20.132.254:45079)
0811 14:25:41.503116 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:41.503125 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:41.503160 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:25:41.503556 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:41.503562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:41.503605 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:41.503771 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:41.504493 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.505839 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.506629 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.508116 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.508271 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.510956 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:41.510960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:41.510961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:41.510973 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:41.512964 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.513427 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.513430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.513431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.513536 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.513777 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.513777 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.513778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.513998 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:41.514100 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:41.514261 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 14:25:41.514364 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":79,"threads_started":1}
I20260811 14:25:41.516595 22313 catalog_manager.cc:1347] Generated new cluster ID: 3d020e8eebc64cce95dfaa3d414461a0
I20260811 14:25:41.516656 22313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:25:41.527756 22313 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:41.528357 22313 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:41.533878 22313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: Generated new TSK 0
I20260811 14:25:41.534075 22313 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:41.563599 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45079
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:41.650478 22330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:41.650727 22330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:41.650768 22330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:41.651964 22330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:41.652040 22330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:41.652079 22330 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:25:41.652141 22330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:41.653622 22330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:45079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:41.653905 22330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:41.654151 22330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:41.659437 22340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.659452 22338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.659452 22337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:41.659749 22330 server_base.cc:1034] running on GCE node
I20260811 14:25:41.659956 22330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:41.660203 22330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:41.661358 22330 hybrid_clock.cc:648] HybridClock initialized: now 1786458341661345 us; error 34 us; skew 500 ppm
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:41.663921 22330 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:41.664424 22330 webserver.cc:460] Webserver started at http://127.20.132.193:45045/ using document root <none> and password file <none>
I20260811 14:25:41.664673 22330 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:41.664755 22330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:41.664909 22330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:41.666040 22330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "b536832e31514adfabd8016224ce18b6"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "6c8eb7a5f20e6c0fc81a8afb9b40f4cb"
server_key_iv: "dcb8b44adf6492f381f423ea486759ce"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.666412 22330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "b536832e31514adfabd8016224ce18b6"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "6c8eb7a5f20e6c0fc81a8afb9b40f4cb"
server_key_iv: "dcb8b44adf6492f381f423ea486759ce"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.667744 22330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:41.668654 22348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.668885 22330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:25:41.668967 22330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "b536832e31514adfabd8016224ce18b6"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "6c8eb7a5f20e6c0fc81a8afb9b40f4cb"
server_key_iv: "dcb8b44adf6492f381f423ea486759ce"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.669018 22330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:41.680286 22330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:41.682140 22330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:41.682262 22330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:41.682725 22330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:41.682760 22330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.682782 22330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:41.682843 22330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.690191 22330 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:38795
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:41.690284 22478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:38795 every 8 connection(s)
I20260811 14:25:41.690578 22330 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:25:41.693533 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.683376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:44583 (local address 127.20.132.254:45079)
0811 14:25:41.683453 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:41.683456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:41.683636 (+ 180us) server_negotiation.cc:407] Connection header received
0811 14:25:41.684242 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:41.684243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:41.684257 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:41.684320 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:41.685182 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.686047 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.687608 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.687999 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.688083 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.690830 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:41.690832 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:41.690832 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:41.690840 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:41.692126 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.692628 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.692629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.692630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.692696 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.692928 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.692929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.692929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.693034 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:41.693086 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:41.693372 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 14:25:41.693469 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:25:41.693639 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.683336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.20.132.193:44583)
0811 14:25:41.683523 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:41.683563 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:41.684121 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:41.684395 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:41.684400 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:41.684773 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:41.685057 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.685063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.686155 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.686156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.687510 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.687514 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.688094 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.688095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.688262 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.688846 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:41.688859 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:41.690728 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:41.692258 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.692265 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.692267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.692546 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.692766 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.692767 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.692767 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.692868 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.693101 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:41.693106 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:41.693217 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 14:25:41.693301 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:25:41.693417 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260811 14:25:41.694144 22479 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45079
I20260811 14:25:41.694243 22479 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:41.694438 22479 heartbeater.cc:511] Master 127.20.132.254:45079 requested a full tablet report, sending...
I20260811 14:25:41.694991 22251 ts_manager.cc:194] Registered new tserver with Master: b536832e31514adfabd8016224ce18b6 (127.20.132.193:38795)
I20260811 14:25:41.695807 22251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:44583
I20260811 14:25:41.699401 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 22330
I20260811 14:25:41.699530 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:41.699721 21011 external_mini_cluster.cc:1428] Setting key 46a49d8fd8244625e230a0d1b16adee1
I20260811 14:25:41.701599 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.695356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:36359 (local address 127.20.132.254:45079)
0811 14:25:41.695390 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:41.695391 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:41.695599 (+ 208us) server_negotiation.cc:407] Connection header received
0811 14:25:41.695674 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:41.695675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:41.695684 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:41.695740 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:41.696156 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.696631 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.697346 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.697566 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.697663 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.698631 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:41.698632 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:41.698633 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:41.698639 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:41.700409 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.700778 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.700779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.700779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.700835 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.701062 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.701063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.701064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.701181 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:41.701263 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:41.701423 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 14:25:41.701508 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:25:41.701622 22485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.695321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.20.132.193:36359)
0811 14:25:41.695522 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:41.695532 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:41.695614 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:41.695746 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:41.695746 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:41.695970 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:41.696032 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.696034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.696736 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.696737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.697251 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.697253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.697665 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.697666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.697741 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.698225 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:41.698230 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:41.698507 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:41.700503 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.700504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.700504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.700693 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.700920 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.700921 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.700921 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.700982 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.701254 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:41.701255 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:41.701303 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 14:25:41.701399 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 14:25:41.701511 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":134,"threads_started":1}
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:41.728222 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45079
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:41.812258 22488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:41.812453 22488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:41.812475 22488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:41.813638 22488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:41.813680 22488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:41.813701 22488 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:25:41.813719 22488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:41.815164 22488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:45079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:41.815404 22488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:41.815670 22488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:41.820812 22495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.820809 22497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.820835 22494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:41.821216 22488 server_base.cc:1034] running on GCE node
I20260811 14:25:41.821448 22488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:41.821709 22488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:41.822903 22488 hybrid_clock.cc:648] HybridClock initialized: now 1786458341822896 us; error 42 us; skew 500 ppm
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:41.825507 22488 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:41.825959 22488 webserver.cc:460] Webserver started at http://127.20.132.194:39173/ using document root <none> and password file <none>
I20260811 14:25:41.826165 22488 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:41.826215 22488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:41.826305 22488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:41.827293 22488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "1be2087dc3a743ba8f11e1d1d1694e3d"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "db09c540d75c0db7a3bf40a29904b61e"
server_key_iv: "b1bcc6a72adfc5247d607c3e1f9340a5"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.827652 22488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "1be2087dc3a743ba8f11e1d1d1694e3d"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "db09c540d75c0db7a3bf40a29904b61e"
server_key_iv: "b1bcc6a72adfc5247d607c3e1f9340a5"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.829005 22488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:41.829716 22504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.829922 22488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:25:41.830014 22488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "1be2087dc3a743ba8f11e1d1d1694e3d"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "db09c540d75c0db7a3bf40a29904b61e"
server_key_iv: "b1bcc6a72adfc5247d607c3e1f9340a5"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.830088 22488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:41.837980 22488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:41.840263 22488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:41.840376 22488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:41.840878 22488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:41.840919 22488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.840940 22488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:41.840955 22488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:41.848605 22488 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:43625
I20260811 14:25:41.848699 22632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:43625 every 8 connection(s)
I20260811 14:25:41.849084 22488 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:41.851209 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.841312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:41891 (local address 127.20.132.254:45079)
0811 14:25:41.841360 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:41.841366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:41.841586 (+ 220us) server_negotiation.cc:407] Connection header received
0811 14:25:41.842144 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:41.842145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:41.842160 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:41.842218 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:41.842829 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.843680 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.844940 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.845286 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.845399 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.848423 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:41.848425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:41.848425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:41.848434 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:41.850037 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.850458 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.850459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.850460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.850514 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.850741 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.850742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.850742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.850849 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:41.850897 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:41.851085 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 14:25:41.851143 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:25:41.851460 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.841284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.20.132.194:41891)
0811 14:25:41.841464 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:41.841498 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:41.842027 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:41.842284 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:41.842288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:41.842534 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:41.842712 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.842716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.843806 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.843807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.844867 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.844869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.845433 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.845434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.845547 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.846036 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:41.846043 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:41.848312 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:41.850137 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.850144 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.850145 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.850378 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.850578 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.850578 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.850579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.850682 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.850893 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:41.850895 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:41.850997 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 14:25:41.851071 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:25:41.851189 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260811 14:25:41.851980 22633 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45079
I20260811 14:25:41.852065 22633 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:41.852293 22633 heartbeater.cc:511] Master 127.20.132.254:45079 requested a full tablet report, sending...
I20260811 14:25:41.852702 22251 ts_manager.cc:194] Registered new tserver with Master: 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625)
I20260811 14:25:41.853166 22251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:41891
I20260811 14:25:41.853590 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 22488
I20260811 14:25:41.853688 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:41.853892 21011 external_mini_cluster.cc:1428] Setting key f123ef6afd76279d89956a88b32e9c34
I20260811 14:25:41.859568 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.853247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:45649 (local address 127.20.132.254:45079)
0811 14:25:41.853302 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:41.853304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:41.853512 (+ 208us) server_negotiation.cc:407] Connection header received
0811 14:25:41.853533 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:41.853534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:41.853544 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:41.853596 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:41.854034 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.854751 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.855778 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.855952 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.856007 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.856973 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:41.856975 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:41.856975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:41.856983 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:41.858398 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.858809 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.858810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.858810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.858858 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:41.859077 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:41.859078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:41.859078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:41.859232 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:41.859286 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:41.859459 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 14:25:41.859513 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 14:25:41.859663 22641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:41.853158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.20.132.194:45649)
0811 14:25:41.853381 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:41.853391 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:41.853467 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:41.853626 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:41.853626 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:41.853854 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:41.853921 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.853923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.854861 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.854862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.855683 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:41.855686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:41.856031 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:41.856032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:41.856115 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:41.856612 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:41.856616 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:41.856881 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:41.858485 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.858486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.858486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.858729 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.858932 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:41.858934 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:41.858934 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:41.859009 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:41.859307 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:41.859309 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:41.859361 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 14:25:41.859444 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 14:25:41.859550 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:41.884037 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45079
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:42489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:41.967262 22644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:41.967459 22644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:41.967482 22644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:41.968763 22644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:41.968817 22644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:41.968837 22644 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:25:41.968853 22644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:41.970211 22644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:42489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:45079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:41.970384 22644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:41.970563 22644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:41.975795 22649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:41.975849 22650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:41.975986 22644 server_base.cc:1034] running on GCE node
W20260811 14:25:41.975862 22652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:41.976400 22644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:41.976646 22644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:41.977833 22644 hybrid_clock.cc:648] HybridClock initialized: now 1786458341977837 us; error 40 us; skew 500 ppm
Aug 11 14:25:41 dist-test-slave-cbbz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:41.980443 22644 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:41.980899 22644 webserver.cc:460] Webserver started at http://127.20.132.195:44003/ using document root <none> and password file <none>
I20260811 14:25:41.981120 22644 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:41.981197 22644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:41.981343 22644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:41.982376 22644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "0e6ffab43d604401a6deb8ae02555635"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "814a14aa599750fefc49393375dd2674"
server_key_iv: "163a6321cd45e8f4bf2b59d5742a3646"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.982740 22644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "0e6ffab43d604401a6deb8ae02555635"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "814a14aa599750fefc49393375dd2674"
server_key_iv: "163a6321cd45e8f4bf2b59d5742a3646"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.984097 22644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:41.984934 22661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:41.985194 22644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:41.985313 22644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "0e6ffab43d604401a6deb8ae02555635"
format_stamp: "Formatted at 2026-08-11 14:25:41 on dist-test-slave-cbbz"
server_key: "814a14aa599750fefc49393375dd2674"
server_key_iv: "163a6321cd45e8f4bf2b59d5742a3646"
server_key_version: "encryptionkey@0"
I20260811 14:25:41.985400 22644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:42.026574 22644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:42.028677 22644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:42.028853 22644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:42.029479 22644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:42.029554 22644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:42.029593 22644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:42.029623 22644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:25:42 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:42.037845 22644 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:37249
I20260811 14:25:42.037982 22788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:37249 every 8 connection(s)
I20260811 14:25:42.038264 22644 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:42.039388 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 22644
I20260811 14:25:42.039507 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:42.039731 21011 external_mini_cluster.cc:1428] Setting key ab603e8073bd7ad4d66313195ff70c5e
I20260811 14:25:42.041227 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.030056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:37353 (local address 127.20.132.254:45079)
0811 14:25:42.030162 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.030165 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.030356 (+ 191us) server_negotiation.cc:407] Connection header received
0811 14:25:42.030922 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.030923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.030938 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.031013 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:42.032004 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.032691 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.033983 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.034233 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.034325 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.037908 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:42.037909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:42.037909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:42.037918 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:42.039591 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.040133 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.040155 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.040155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.040227 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.040535 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.040536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.040536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.040684 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:42.040758 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.041081 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.041162 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:25:42.041311 22670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.030035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.20.132.195:37353)
0811 14:25:42.030229 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.030269 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.030807 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.031153 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.031158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.031565 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:42.031885 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.031893 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.032827 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.032828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.033858 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.033862 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.034421 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.034423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.034573 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.035192 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:42.035202 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:42.037795 (+ 2593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:42.039692 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:42.039699 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:42.039701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:42.040014 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:42.040311 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:42.040311 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:42.040312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:42.040457 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:42.040772 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:42.040778 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:42.040925 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.041017 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.041141 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
I20260811 14:25:42.041971 22789 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45079
I20260811 14:25:42.042093 22789 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:42.042291 22789 heartbeater.cc:511] Master 127.20.132.254:45079 requested a full tablet report, sending...
I20260811 14:25:42.042755 22251 ts_manager.cc:194] Registered new tserver with Master: 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249)
I20260811 14:25:42.043270 22251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:37353
I20260811 14:25:42.048597 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.043124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47247 (local address 127.20.132.254:45079)
0811 14:25:42.043169 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.043171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.043237 (+ 66us) server_negotiation.cc:407] Connection header received
0811 14:25:42.043311 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.043312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.043322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.043379 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:42.043835 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.044368 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.045154 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.045355 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.045416 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.046358 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:42.046359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:42.046360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:42.046364 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:42.047502 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.047809 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.047810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.047810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.047857 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.048024 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.048025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.048025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.048280 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:42.048344 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.048478 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.048539 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:25:42.048645 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.043054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.20.132.195:47247)
0811 14:25:42.043182 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.043193 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.043253 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.043451 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.043451 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.043683 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:42.043748 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.043750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.044492 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.044493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.045022 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.045023 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.045433 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.045433 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.045484 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.045976 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:42.045980 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:42.046283 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:42.047582 (+ 1299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:42.047583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:42.047583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:42.047742 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:42.047918 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:42.047919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:42.047919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:42.047969 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:42.048345 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:42.048346 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:42.048387 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.048461 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.048552 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
I20260811 14:25:42.051671 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:25:42 dist-test-slave-cbbz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458342, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:25:42 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458342, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:42.075783 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.068373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38306 (local address 127.20.132.254:45079)
0811 14:25:42.068419 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.068421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.068429 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:25:42.068455 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.068456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.068466 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.068540 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:42.069176 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.069664 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.070411 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.070605 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.070688 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.073078 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:42.073080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:42.073081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:42.073088 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:42.074567 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.074952 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.074954 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.074954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.075011 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.075225 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.075226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.075227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.075377 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:42.075494 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.075598 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.075676 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:25:42.077569 22251 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:42.079114 22251 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:42.085608 22811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.081499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:37249 (local address 127.0.0.1:40676)
0811 14:25:42.081801 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.081811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.081853 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.082217 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.082220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.082223 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.082290 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.082292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.083243 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.083244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.084430 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.084433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.085310 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.085312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.085392 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.085405 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.085475 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.085529 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":87,"threads_started":1}
I20260811 14:25:42.085644 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.081792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40676 (local address 127.20.132.195:37249)
0811 14:25:42.081978 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.081984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.081995 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:25:42.082035 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.082037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.082052 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.082126 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.082377 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.083146 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.084524 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.085209 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.085302 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.085363 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.085504 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.085545 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
I20260811 14:25:42.085924 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.081499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38795 (local address 127.0.0.1:58664)
0811 14:25:42.081929 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.081939 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.081974 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.082287 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.082289 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.082291 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.082353 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.082355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.083738 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.083738 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.084675 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.084678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.085673 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.085675 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.085763 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.085768 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.085818 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.085854 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":7,"thread_start_us":86,"threads_started":1}
I20260811 14:25:42.086244 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.081791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.20.132.193:38795)
0811 14:25:42.082015 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.082020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.082032 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:25:42.082100 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.082103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.082119 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.082210 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.082463 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.083625 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.084765 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.085498 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.085573 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.085634 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.086091 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.086131 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":99,"threads_started":1}
I20260811 14:25:42.086256 22810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.081494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:43625 (local address 127.0.0.1:38810)
0811 14:25:42.081620 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.081678 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.081749 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.082408 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.082409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.082411 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.082456 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.082457 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.083722 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.083723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.084845 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.084848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.086044 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.086045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.086117 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.086121 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.086152 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.086188 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":22,"thread_start_us":85,"threads_started":1}
I20260811 14:25:42.086366 22719 tablet_service.cc:1467] Processing CreateTablet for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b (DEFAULT_TABLE table=test-table [id=025cfb6d642b4d2197a69b7d5b397c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:42.086597 22815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.082015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38810 (local address 127.20.132.194:43625)
0811 14:25:42.082228 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.082232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.082241 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:42.082281 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.082282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.082295 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.082406 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.082518 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.083618 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.084935 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.085645 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.086363 (+ 718us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.086434 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.086457 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.086501 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":99,"threads_started":1}
I20260811 14:25:42.086802 22719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.086930 22403 tablet_service.cc:1467] Processing CreateTablet for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b (DEFAULT_TABLE table=test-table [id=025cfb6d642b4d2197a69b7d5b397c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:42.087119 22559 tablet_service.cc:1467] Processing CreateTablet for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b (DEFAULT_TABLE table=test-table [id=025cfb6d642b4d2197a69b7d5b397c12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:42.087291 22403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.087419 22559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.090107 22816 tablet_bootstrap.cc:492] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Bootstrap starting.
I20260811 14:25:42.091012 22818 tablet_bootstrap.cc:492] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Bootstrap starting.
I20260811 14:25:42.091133 22816 tablet_bootstrap.cc:654] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.091536 22816 log.cc:824] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:42.091885 22818 tablet_bootstrap.cc:654] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.092267 22818 log.cc:824] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:42.092311 22817 tablet_bootstrap.cc:492] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Bootstrap starting.
I20260811 14:25:42.092448 22816 tablet_bootstrap.cc:492] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: No bootstrap required, opened a new log
I20260811 14:25:42.092526 22816 ts_tablet_manager.cc:1397] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:25:42.092896 22817 tablet_bootstrap.cc:654] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.093211 22817 log.cc:824] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:42.094041 22817 tablet_bootstrap.cc:492] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: No bootstrap required, opened a new log
I20260811 14:25:42.094138 22817 ts_tablet_manager.cc:1397] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:25:42.094488 22816 raft_consensus.cc:348] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.094645 22816 raft_consensus.cc:374] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.094683 22816 raft_consensus.cc:729] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6ffab43d604401a6deb8ae02555635, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.094803 22816 consensus_queue.cc:260] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.095079 22816 ts_tablet_manager.cc:1428] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:25:42.095141 22789 heartbeater.cc:503] Master 127.20.132.254:45079 was elected leader, sending a full tablet report...
I20260811 14:25:42.095772 22818 tablet_bootstrap.cc:492] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: No bootstrap required, opened a new log
I20260811 14:25:42.095870 22818 ts_tablet_manager.cc:1397] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 14:25:42.096167 22817 raft_consensus.cc:348] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.096326 22817 raft_consensus.cc:374] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.096360 22817 raft_consensus.cc:729] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be2087dc3a743ba8f11e1d1d1694e3d, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.096474 22817 consensus_queue.cc:260] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.096750 22817 ts_tablet_manager.cc:1428] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:25:42.096798 22633 heartbeater.cc:503] Master 127.20.132.254:45079 was elected leader, sending a full tablet report...
I20260811 14:25:42.097957 22818 raft_consensus.cc:348] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.098071 22818 raft_consensus.cc:374] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.098093 22818 raft_consensus.cc:729] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b536832e31514adfabd8016224ce18b6, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.098204 22818 consensus_queue.cc:260] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.098459 22818 ts_tablet_manager.cc:1428] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:25:42.098529 22479 heartbeater.cc:503] Master 127.20.132.254:45079 was elected leader, sending a full tablet report...
W20260811 14:25:42.099758 22634 tablet.cc:2369] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:25:42.137516 22824 raft_consensus.cc:482] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:42.137670 22824 raft_consensus.cc:504] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.138024 22824 leader_election.cc:288] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625), 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249)
I20260811 14:25:42.140980 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.138229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:43625 (local address 127.20.132.193:59041)
0811 14:25:42.138293 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.138308 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.138361 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.138566 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.138568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.138569 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.138647 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.138649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.139292 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.139293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.140091 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.140093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.140711 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.140712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.140796 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.140799 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.140869 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.140907 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":39}
I20260811 14:25:42.140978 22815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.138339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:59041 (local address 127.20.132.194:43625)
0811 14:25:42.138421 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.138424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.138434 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:42.138463 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.138464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.138482 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.138561 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.138726 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.139200 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.140245 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.140610 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.140703 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.140712 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.140874 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.140908 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:25:42.141072 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.138354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:48871 (local address 127.20.132.195:37249)
0811 14:25:42.138411 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.138413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.138544 (+ 131us) server_negotiation.cc:407] Connection header received
0811 14:25:42.138607 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.138608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.138616 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.138682 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.138859 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.139324 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.140353 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.140707 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.140804 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.140812 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.140969 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.141006 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 14:25:42.141305 22826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.138228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:37249 (local address 127.20.132.193:48871)
0811 14:25:42.138480 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.138488 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.138553 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.138707 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.138708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.138710 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.138781 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.138782 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.139419 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.139420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.140264 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.140266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.140806 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.140807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.140889 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.140893 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.140964 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.141003 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":82,"thread_start_us":110,"threads_started":1}
I20260811 14:25:42.141323 22583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbd0e7ff9fc46ba945ebf8b969ef80b" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" is_pre_election: true
I20260811 14:25:42.141474 22583 raft_consensus.cc:2454] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 0.
I20260811 14:25:42.141647 22741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbd0e7ff9fc46ba945ebf8b969ef80b" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6ffab43d604401a6deb8ae02555635" is_pre_election: true
I20260811 14:25:42.141726 22349 leader_election.cc:302] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be2087dc3a743ba8f11e1d1d1694e3d, b536832e31514adfabd8016224ce18b6; no voters:
I20260811 14:25:42.141788 22741 raft_consensus.cc:2454] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 0.
I20260811 14:25:42.141897 22824 raft_consensus.cc:2781] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:42.141990 22824 raft_consensus.cc:482] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:42.142016 22824 raft_consensus.cc:3037] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.143152 22824 raft_consensus.cc:504] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.143318 22824 leader_election.cc:288] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 election: Requested vote from peers 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625), 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249)
I20260811 14:25:42.143447 22583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbd0e7ff9fc46ba945ebf8b969ef80b" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d"
I20260811 14:25:42.143446 22741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbd0e7ff9fc46ba945ebf8b969ef80b" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6ffab43d604401a6deb8ae02555635"
I20260811 14:25:42.143522 22741 raft_consensus.cc:3037] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.143517 22583 raft_consensus.cc:3037] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.144347 22741 raft_consensus.cc:2454] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 1.
I20260811 14:25:42.144421 22583 raft_consensus.cc:2454] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 1.
I20260811 14:25:42.144557 22352 leader_election.cc:302] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e6ffab43d604401a6deb8ae02555635, b536832e31514adfabd8016224ce18b6; no voters:
I20260811 14:25:42.144685 22824 raft_consensus.cc:2781] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:42.144893 22824 raft_consensus.cc:686] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 1 LEADER]: Becoming Leader. State: Replica: b536832e31514adfabd8016224ce18b6, State: Running, Role: LEADER
I20260811 14:25:42.144989 22824 consensus_queue.cc:237] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.145833 22252 catalog_manager.cc:5495] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to b536832e31514adfabd8016224ce18b6 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "b536832e31514adfabd8016224ce18b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } health_report { overall_health: UNKNOWN } } }
I20260811 14:25:42.164624 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.162237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58666 (local address 127.20.132.193:38795)
0811 14:25:42.162310 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.162312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.162320 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:25:42.162353 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.162354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.162369 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.162428 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:42.162581 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.163052 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.163830 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.164013 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.164065 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.164315 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.164404 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.164466 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.164516 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.164535 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:25:42.166527 22741 raft_consensus.cc:1261] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Refusing update from remote peer b536832e31514adfabd8016224ce18b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:42.166527 22583 raft_consensus.cc:1261] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Refusing update from remote peer b536832e31514adfabd8016224ce18b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:42.167011 22824 consensus_queue.cc:1035] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:42.167178 22827 consensus_queue.cc:1035] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:42.170681 22831 mvcc.cc:205] Tried to move back new op lower bound from 7317333369510969344 to 7317333369426395136. Current Snapshot: MvccSnapshot[applied={T|T < 7317333369510969344}]
I20260811 14:25:42.171037 22832 mvcc.cc:205] Tried to move back new op lower bound from 7317333369510969344 to 7317333369426395136. Current Snapshot: MvccSnapshot[applied={T|T < 7317333369510969344}]
I20260811 14:25:42.175345 22252 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:42.175489 22252 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:42.176429 22252 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: Sending DeleteTablet for 3 replicas of tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b
I20260811 14:25:42.176985 22559 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:42 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:38810
I20260811 14:25:42.177042 22719 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:42 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:40676
I20260811 14:25:42.177222 22403 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:42 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:58664
I20260811 14:25:42.177354 22842 tablet_replica.cc:330] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: stopping tablet replica
I20260811 14:25:42.177608 22842 raft_consensus.cc:2229] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:42.177670 22841 tablet_replica.cc:330] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: stopping tablet replica
I20260811 14:25:42.177634 22252 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 14:25:42.177757 22841 raft_consensus.cc:2229] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:42.177760 22842 raft_consensus.cc:2258] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 14:25:42.177776 22252 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:42.177855 22841 raft_consensus.cc:2258] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:42.178001 22843 tablet_replica.cc:330] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: stopping tablet replica
I20260811 14:25:42.178097 22843 raft_consensus.cc:2229] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:42.178242 22843 raft_consensus.cc:2258] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:42.178759 22843 ts_tablet_manager.cc:1905] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:42.179214 22403 tablet_service.cc:1467] Processing CreateTablet for tablet c59577daf5b2438f92b68a1b3d587c29 (DEFAULT_TABLE table=test-table [id=ce6151ac7db3465c9115586d522ef5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:42.179252 22559 tablet_service.cc:1467] Processing CreateTablet for tablet c59577daf5b2438f92b68a1b3d587c29 (DEFAULT_TABLE table=test-table [id=ce6151ac7db3465c9115586d522ef5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:42.179333 22403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59577daf5b2438f92b68a1b3d587c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.179348 22559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59577daf5b2438f92b68a1b3d587c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.180711 22719 tablet_service.cc:1467] Processing CreateTablet for tablet c59577daf5b2438f92b68a1b3d587c29 (DEFAULT_TABLE table=test-table [id=ce6151ac7db3465c9115586d522ef5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:42.180840 22719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59577daf5b2438f92b68a1b3d587c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.180930 22818 tablet_bootstrap.cc:492] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Bootstrap starting.
I20260811 14:25:42.181385 22818 tablet_bootstrap.cc:654] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.182155 22818 tablet_bootstrap.cc:492] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: No bootstrap required, opened a new log
I20260811 14:25:42.182222 22818 ts_tablet_manager.cc:1397] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:25:42.182415 22816 tablet_bootstrap.cc:492] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Bootstrap starting.
I20260811 14:25:42.182394 22818 raft_consensus.cc:348] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.182475 22818 raft_consensus.cc:374] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.182502 22818 raft_consensus.cc:729] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b536832e31514adfabd8016224ce18b6, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.182544 22818 consensus_queue.cc:260] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.182654 22818 ts_tablet_manager.cc:1428] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:42.182932 22841 ts_tablet_manager.cc:1905] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:42.182987 22816 tablet_bootstrap.cc:654] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.183286 22817 tablet_bootstrap.cc:492] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Bootstrap starting.
I20260811 14:25:42.183629 22842 ts_tablet_manager.cc:1905] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:42.183681 22817 tablet_bootstrap.cc:654] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.184348 22817 tablet_bootstrap.cc:492] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: No bootstrap required, opened a new log
I20260811 14:25:42.184394 22817 ts_tablet_manager.cc:1397] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:42.184540 22817 raft_consensus.cc:348] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.184638 22817 raft_consensus.cc:374] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.184661 22817 raft_consensus.cc:729] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be2087dc3a743ba8f11e1d1d1694e3d, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.184703 22817 consensus_queue.cc:260] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.184830 22817 ts_tablet_manager.cc:1428] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:42.185647 22842 ts_tablet_manager.cc:1918] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:25:42.185729 22842 log.cc:1196] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/2cbd0e7ff9fc46ba945ebf8b969ef80b
I20260811 14:25:42.185994 22842 ts_tablet_manager.cc:1939] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 0e6ffab43d604401a6deb8ae02555635: Deleting consensus metadata
I20260811 14:25:42.186028 22843 ts_tablet_manager.cc:1918] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:25:42.186090 22843 log.cc:1196] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/2cbd0e7ff9fc46ba945ebf8b969ef80b
I20260811 14:25:42.186327 22843 ts_tablet_manager.cc:1939] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P b536832e31514adfabd8016224ce18b6: Deleting consensus metadata
I20260811 14:25:42.186517 22841 ts_tablet_manager.cc:1918] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:25:42.186594 22841 log.cc:1196] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/2cbd0e7ff9fc46ba945ebf8b969ef80b
I20260811 14:25:42.186926 22235 catalog_manager.cc:4841] TS b536832e31514adfabd8016224ce18b6 (127.20.132.193:38795): tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b (table test-table [id=025cfb6d642b4d2197a69b7d5b397c12]) successfully deleted
I20260811 14:25:42.187201 22841 ts_tablet_manager.cc:1939] T 2cbd0e7ff9fc46ba945ebf8b969ef80b P 1be2087dc3a743ba8f11e1d1d1694e3d: Deleting consensus metadata
I20260811 14:25:42.187186 22237 catalog_manager.cc:4841] TS 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249): tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b (table test-table [id=025cfb6d642b4d2197a69b7d5b397c12]) successfully deleted
I20260811 14:25:42.187608 22234 catalog_manager.cc:4841] TS 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625): tablet 2cbd0e7ff9fc46ba945ebf8b969ef80b (table test-table [id=025cfb6d642b4d2197a69b7d5b397c12]) successfully deleted
I20260811 14:25:42.187868 22816 tablet_bootstrap.cc:492] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: No bootstrap required, opened a new log
I20260811 14:25:42.187911 22816 ts_tablet_manager.cc:1397] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 14:25:42.188103 22816 raft_consensus.cc:348] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.188220 22816 raft_consensus.cc:374] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.188253 22816 raft_consensus.cc:729] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6ffab43d604401a6deb8ae02555635, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.188320 22816 consensus_queue.cc:260] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.188416 22816 ts_tablet_manager.cc:1428] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260811 14:25:42.191563 22480 tablet.cc:2369] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:25:42.288940 22790 tablet.cc:2369] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:25:42.328406 22824 raft_consensus.cc:482] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:42.328539 22824 raft_consensus.cc:504] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.328763 22824 leader_election.cc:288] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625), 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249)
I20260811 14:25:42.328985 22583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59577daf5b2438f92b68a1b3d587c29" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" is_pre_election: true
I20260811 14:25:42.328997 22741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59577daf5b2438f92b68a1b3d587c29" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6ffab43d604401a6deb8ae02555635" is_pre_election: true
I20260811 14:25:42.329103 22583 raft_consensus.cc:2454] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 0.
I20260811 14:25:42.329103 22741 raft_consensus.cc:2454] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 0.
I20260811 14:25:42.329293 22352 leader_election.cc:302] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e6ffab43d604401a6deb8ae02555635, b536832e31514adfabd8016224ce18b6; no voters:
I20260811 14:25:42.329419 22824 raft_consensus.cc:2781] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:42.329463 22824 raft_consensus.cc:482] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:42.329486 22824 raft_consensus.cc:3037] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.330157 22824 raft_consensus.cc:504] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.330307 22824 leader_election.cc:288] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 election: Requested vote from peers 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625), 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249)
I20260811 14:25:42.330471 22741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59577daf5b2438f92b68a1b3d587c29" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6ffab43d604401a6deb8ae02555635"
I20260811 14:25:42.330545 22741 raft_consensus.cc:3037] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.330678 22583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59577daf5b2438f92b68a1b3d587c29" candidate_uuid: "b536832e31514adfabd8016224ce18b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d"
I20260811 14:25:42.330762 22583 raft_consensus.cc:3037] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.331391 22741 raft_consensus.cc:2454] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 1.
I20260811 14:25:42.331565 22352 leader_election.cc:302] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e6ffab43d604401a6deb8ae02555635, b536832e31514adfabd8016224ce18b6; no voters:
I20260811 14:25:42.331586 22583 raft_consensus.cc:2454] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b536832e31514adfabd8016224ce18b6 in term 1.
I20260811 14:25:42.331691 22824 raft_consensus.cc:2781] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:42.331748 22824 raft_consensus.cc:686] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 1 LEADER]: Becoming Leader. State: Replica: b536832e31514adfabd8016224ce18b6, State: Running, Role: LEADER
I20260811 14:25:42.331800 22824 consensus_queue.cc:237] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.332449 22252 catalog_manager.cc:5495] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to b536832e31514adfabd8016224ce18b6 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "b536832e31514adfabd8016224ce18b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } health_report { overall_health: UNKNOWN } } }
Aug 11 14:25:42 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458341, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:42.387919 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.381059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.20.132.254:45079)
0811 14:25:42.381143 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.381146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.381284 (+ 138us) server_negotiation.cc:407] Connection header received
0811 14:25:42.381391 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.381392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.381400 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.381466 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:42.381972 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.382451 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.383168 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.383349 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.383440 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.385510 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:42.385511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:42.385511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:42.385518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:42.386664 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.387050 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.387051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.387051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.387111 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.387322 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.387323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.387324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.387433 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:42.387515 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.387707 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.387792 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:25:42.388002 22854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.380982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45079 (local address 127.0.0.1:38308)
0811 14:25:42.381206 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.381216 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.381305 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.381471 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.381472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.381820 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:42.381868 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.381871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.382546 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.382547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.383059 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.383061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.383439 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.383440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.383490 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.383997 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:42.384001 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:42.385405 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:42.386753 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:42.386762 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:42.386765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:42.386954 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:42.387181 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:42.387182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:42.387182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:42.387253 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:42.387505 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:42.387513 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:42.387557 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.387684 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.387868 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":87,"thread_start_us":101,"threads_started":1}
I20260811 14:25:42.390241 22252 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:38308:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 14:25:42.390533 22252 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:42.392059 22403 tablet_service.cc:1467] Processing CreateTablet for tablet 01f5734744c74ffdabac76d600791581 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebea76f8b38244239e55faaf13a0db04]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:25:42.392205 22719 tablet_service.cc:1467] Processing CreateTablet for tablet 01f5734744c74ffdabac76d600791581 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebea76f8b38244239e55faaf13a0db04]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:25:42.392349 22403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01f5734744c74ffdabac76d600791581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.392383 22719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01f5734744c74ffdabac76d600791581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.393682 22816 tablet_bootstrap.cc:492] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: Bootstrap starting.
I20260811 14:25:42.393754 22559 tablet_service.cc:1467] Processing CreateTablet for tablet 01f5734744c74ffdabac76d600791581 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebea76f8b38244239e55faaf13a0db04]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:25:42.393893 22559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01f5734744c74ffdabac76d600791581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:42.394121 22816 tablet_bootstrap.cc:654] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.395200 22817 tablet_bootstrap.cc:492] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: Bootstrap starting.
I20260811 14:25:42.395244 22818 tablet_bootstrap.cc:492] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: Bootstrap starting.
I20260811 14:25:42.395553 22818 tablet_bootstrap.cc:654] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.395625 22817 tablet_bootstrap.cc:654] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:42.396251 22818 tablet_bootstrap.cc:492] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: No bootstrap required, opened a new log
I20260811 14:25:42.396310 22818 ts_tablet_manager.cc:1397] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:25:42.396428 22816 tablet_bootstrap.cc:492] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: No bootstrap required, opened a new log
I20260811 14:25:42.396481 22816 ts_tablet_manager.cc:1397] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 14:25:42.396437 22818 raft_consensus.cc:348] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.396523 22818 raft_consensus.cc:374] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.396548 22818 raft_consensus.cc:729] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b536832e31514adfabd8016224ce18b6, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.396608 22818 consensus_queue.cc:260] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.396652 22816 raft_consensus.cc:348] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.396715 22818 ts_tablet_manager.cc:1428] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:42.396728 22816 raft_consensus.cc:374] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.396754 22816 raft_consensus.cc:729] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6ffab43d604401a6deb8ae02555635, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.396814 22816 consensus_queue.cc:260] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.396834 22824 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.396903 22824 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.396924 22816 ts_tablet_manager.cc:1428] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:42.397009 22822 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.397168 22822 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.397328 22817 tablet_bootstrap.cc:492] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: No bootstrap required, opened a new log
I20260811 14:25:42.397373 22817 ts_tablet_manager.cc:1397] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:25:42.397536 22817 raft_consensus.cc:348] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.397610 22817 raft_consensus.cc:374] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:42.397625 22817 raft_consensus.cc:729] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be2087dc3a743ba8f11e1d1d1694e3d, State: Initialized, Role: FOLLOWER
I20260811 14:25:42.397681 22817 consensus_queue.cc:260] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.397745 22817 ts_tablet_manager.cc:1428] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:42.397846 22823 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.397954 22823 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.592514 22822 raft_consensus.cc:482] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:42.592620 22822 raft_consensus.cc:504] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.592983 22822 leader_election.cc:288] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b536832e31514adfabd8016224ce18b6 (127.20.132.193:38795), 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625)
I20260811 14:25:42.597411 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.593327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:43793 (local address 127.20.132.193:38795)
0811 14:25:42.593373 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.593376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.593456 (+ 80us) server_negotiation.cc:407] Connection header received
0811 14:25:42.593514 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.593515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.593528 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.593594 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.593869 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.594726 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.596308 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.596927 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.597014 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.597024 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.597290 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.597346 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:25:42.597411 22815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.593290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:46215 (local address 127.20.132.194:43625)
0811 14:25:42.593351 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.593354 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.593456 (+ 102us) server_negotiation.cc:407] Connection header received
0811 14:25:42.593514 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.593515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.593526 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.593594 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:42.593881 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.594739 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.596308 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.596923 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.597014 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.597024 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.597290 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.597340 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 14:25:42.597429 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.593247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38795 (local address 127.20.132.195:43793)
0811 14:25:42.593367 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.593379 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.593452 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.593618 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.593619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.593621 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.593709 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.593711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.594828 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.594828 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.596212 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.596215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.597052 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.597053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.597160 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.597168 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.597241 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.597293 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":61,"thread_start_us":60,"threads_started":1}
I20260811 14:25:42.597427 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.593196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:43625 (local address 127.20.132.195:46215)
0811 14:25:42.593367 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.593379 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.593452 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.593621 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.593621 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.593622 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:42.593710 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.593711 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.594827 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.594828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.596212 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.596215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.597049 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.597051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.597160 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.597169 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.597241 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.597293 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":106,"thread_start_us":71,"threads_started":1}
I20260811 14:25:42.597699 22427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01f5734744c74ffdabac76d600791581" candidate_uuid: "0e6ffab43d604401a6deb8ae02555635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b536832e31514adfabd8016224ce18b6" is_pre_election: true
I20260811 14:25:42.597856 22427 raft_consensus.cc:2454] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e6ffab43d604401a6deb8ae02555635 in term 0.
I20260811 14:25:42.598104 22663 leader_election.cc:302] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e6ffab43d604401a6deb8ae02555635, b536832e31514adfabd8016224ce18b6; no voters:
I20260811 14:25:42.598172 22583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01f5734744c74ffdabac76d600791581" candidate_uuid: "0e6ffab43d604401a6deb8ae02555635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" is_pre_election: true
I20260811 14:25:42.598273 22583 raft_consensus.cc:2454] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e6ffab43d604401a6deb8ae02555635 in term 0.
I20260811 14:25:42.598371 22822 raft_consensus.cc:2781] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:42.598420 22822 raft_consensus.cc:482] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:42.598441 22822 raft_consensus.cc:3037] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.599164 22822 raft_consensus.cc:504] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.599316 22822 leader_election.cc:288] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [CANDIDATE]: Term 1 election: Requested vote from peers b536832e31514adfabd8016224ce18b6 (127.20.132.193:38795), 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625)
I20260811 14:25:42.599472 22427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01f5734744c74ffdabac76d600791581" candidate_uuid: "0e6ffab43d604401a6deb8ae02555635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b536832e31514adfabd8016224ce18b6"
I20260811 14:25:42.599560 22427 raft_consensus.cc:3037] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.599493 22583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01f5734744c74ffdabac76d600791581" candidate_uuid: "0e6ffab43d604401a6deb8ae02555635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d"
I20260811 14:25:42.599597 22583 raft_consensus.cc:3037] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:42.600286 22583 raft_consensus.cc:2454] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e6ffab43d604401a6deb8ae02555635 in term 1.
I20260811 14:25:42.600476 22427 raft_consensus.cc:2454] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e6ffab43d604401a6deb8ae02555635 in term 1.
I20260811 14:25:42.600678 22662 leader_election.cc:302] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e6ffab43d604401a6deb8ae02555635, 1be2087dc3a743ba8f11e1d1d1694e3d; no voters:
I20260811 14:25:42.600811 22822 raft_consensus.cc:2781] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:42.600971 22822 raft_consensus.cc:686] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [term 1 LEADER]: Becoming Leader. State: Replica: 0e6ffab43d604401a6deb8ae02555635, State: Running, Role: LEADER
I20260811 14:25:42.601100 22822 consensus_queue.cc:237] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } }
I20260811 14:25:42.601521 22860 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: TxnStatusTablet state changed. Reason: New leader 0e6ffab43d604401a6deb8ae02555635. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.601632 22860 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:25:42.601866 22862 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 14:25:42.601994 22862 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 14:25:42.602051 22251 catalog_manager.cc:5495] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } health_report { overall_health: HEALTHY } } }
I20260811 14:25:42.623538 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.621064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40684 (local address 127.20.132.195:37249)
0811 14:25:42.621128 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.621130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.621139 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:42.621201 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.621202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.621222 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.621275 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:42.621418 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.621929 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.622709 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.622916 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.622999 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.623196 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.623299 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.623389 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.623440 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.623462 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:25:42.623572 22854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.620978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:37249 (local address 127.0.0.1:40684)
0811 14:25:42.621059 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.621073 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.621123 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.621288 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.621289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.621290 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:42.621340 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.621342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.622024 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.622025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.622609 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.622611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.622997 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.622998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.623067 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.623085 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.623374 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.623385 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.623436 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.623490 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 14:25:42.624922 22583 raft_consensus.cc:1261] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Refusing update from remote peer 0e6ffab43d604401a6deb8ae02555635: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:42.625070 22427 raft_consensus.cc:1261] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Refusing update from remote peer 0e6ffab43d604401a6deb8ae02555635: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:42.625191 22860 consensus_queue.cc:1035] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:42.625356 22860 consensus_queue.cc:1035] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:42.625743 22823 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: TxnStatusTablet state changed. Reason: New leader 0e6ffab43d604401a6deb8ae02555635. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.625833 22823 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.625952 22824 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: TxnStatusTablet state changed. Reason: New leader 0e6ffab43d604401a6deb8ae02555635. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.626051 22824 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.626624 22860 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.626705 22860 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:25:42.627058 22822 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.627053 22830 mvcc.cc:205] Tried to move back new op lower bound from 7317333371389530112 to 7317333371294994432. Current Snapshot: MvccSnapshot[applied={T|T < 7317333371389530112}]
I20260811 14:25:42.627132 22822 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 0e6ffab43d604401a6deb8ae02555635: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:25:42.627476 22823 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.627559 22823 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P 1be2087dc3a743ba8f11e1d1d1694e3d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.627805 22824 tablet_replica.cc:439] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0e6ffab43d604401a6deb8ae02555635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b536832e31514adfabd8016224ce18b6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38795 } } peers { permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 } } peers { permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 } } }
I20260811 14:25:42.627887 22824 tablet_replica.cc:442] T 01f5734744c74ffdabac76d600791581 P b536832e31514adfabd8016224ce18b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:42.634207 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.631724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:52533 (local address 127.20.132.195:37249)
0811 14:25:42.631766 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.631768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.631885 (+ 117us) server_negotiation.cc:407] Connection header received
0811 14:25:42.631950 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.631951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.631961 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.632015 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:42.632173 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.632619 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.633481 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.633677 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.633768 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.633955 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.633990 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.634068 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.634127 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.634146 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:25:42.634253 22869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.631648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:37249 (local address 127.20.132.193:52533)
0811 14:25:42.631803 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.631814 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.631897 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.632019 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.632020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.632021 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:42.632078 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.632080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.632739 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.632740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.633384 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.633387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.633772 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.633773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.633843 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.633856 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.634073 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.634075 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.634124 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.634172 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260811 14:25:42.636680 22741 raft_consensus.cc:1261] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Refusing update from remote peer b536832e31514adfabd8016224ce18b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:42.636847 22583 raft_consensus.cc:1261] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Refusing update from remote peer b536832e31514adfabd8016224ce18b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:42.636906 22824 consensus_queue.cc:1035] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e6ffab43d604401a6deb8ae02555635" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:42.637022 22824 consensus_queue.cc:1035] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be2087dc3a743ba8f11e1d1d1694e3d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:42.652998 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.649115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:40783 (local address 127.20.132.193:38795)
0811 14:25:42.649823 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.649826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.649999 (+ 173us) server_negotiation.cc:407] Connection header received
0811 14:25:42.650110 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.650111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.650122 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.650150 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:42.650371 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.650942 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.652209 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.652419 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.652512 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.652723 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.652764 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.652824 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.652898 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.652922 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682}
I20260811 14:25:42.653023 22875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.649044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38795 (local address 127.20.132.195:40783)
0811 14:25:42.649935 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:42.649947 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:42.650025 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:42.650214 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:42.650215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:42.650216 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:42.650282 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.650284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.651033 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.651034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.652052 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:42.652055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.652532 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.652533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:42.652600 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.652615 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:42.652841 (+ 226us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:42.652843 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:25:42.652894 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 14:25:42.652938 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"thread_start_us":90,"threads_started":1}
I20260811 14:25:42.669515 22252 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:42.669613 22252 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:42.670255 22252 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5de9c5b7db524afdb73ac0e5b7c4b371: Sending DeleteTablet for 3 replicas of tablet c59577daf5b2438f92b68a1b3d587c29
I20260811 14:25:42.670514 22559 tablet_service.cc:1514] Processing DeleteTablet for tablet c59577daf5b2438f92b68a1b3d587c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:42 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:38810
I20260811 14:25:42.670593 22403 tablet_service.cc:1514] Processing DeleteTablet for tablet c59577daf5b2438f92b68a1b3d587c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:42 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:58664
I20260811 14:25:42.670640 22841 tablet_replica.cc:330] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: stopping tablet replica
I20260811 14:25:42.670701 22841 raft_consensus.cc:2229] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:42.670693 22843 tablet_replica.cc:330] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: stopping tablet replica
I20260811 14:25:42.670740 22841 raft_consensus.cc:2258] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:42.670771 22843 raft_consensus.cc:2229] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:42.670843 22843 raft_consensus.cc:2258] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:42.670873 22719 tablet_service.cc:1514] Processing DeleteTablet for tablet c59577daf5b2438f92b68a1b3d587c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:42 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:40676
I20260811 14:25:42.670969 22842 tablet_replica.cc:330] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: stopping tablet replica
I20260811 14:25:42.671020 22842 raft_consensus.cc:2229] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:42.671063 22842 raft_consensus.cc:2258] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:42.671180 22841 ts_tablet_manager.cc:1905] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:42.671370 22842 ts_tablet_manager.cc:1905] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:42.671373 22843 ts_tablet_manager.cc:1905] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:42.673223 22843 ts_tablet_manager.cc:1918] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:42.673223 22841 ts_tablet_manager.cc:1918] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:42.673246 22842 ts_tablet_manager.cc:1918] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:42.673290 22843 log.cc:1196] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/c59577daf5b2438f92b68a1b3d587c29
I20260811 14:25:42.673290 22841 log.cc:1196] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/c59577daf5b2438f92b68a1b3d587c29
I20260811 14:25:42.673306 22842 log.cc:1196] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/c59577daf5b2438f92b68a1b3d587c29
I20260811 14:25:42.673535 22843 ts_tablet_manager.cc:1939] T c59577daf5b2438f92b68a1b3d587c29 P b536832e31514adfabd8016224ce18b6: Deleting consensus metadata
I20260811 14:25:42.673542 22842 ts_tablet_manager.cc:1939] T c59577daf5b2438f92b68a1b3d587c29 P 0e6ffab43d604401a6deb8ae02555635: Deleting consensus metadata
I20260811 14:25:42.673563 22841 ts_tablet_manager.cc:1939] T c59577daf5b2438f92b68a1b3d587c29 P 1be2087dc3a743ba8f11e1d1d1694e3d: Deleting consensus metadata
I20260811 14:25:42.673866 22235 catalog_manager.cc:4841] TS b536832e31514adfabd8016224ce18b6 (127.20.132.193:38795): tablet c59577daf5b2438f92b68a1b3d587c29 (table test-table [id=ce6151ac7db3465c9115586d522ef5b2]) successfully deleted
I20260811 14:25:42.673888 22234 catalog_manager.cc:4841] TS 1be2087dc3a743ba8f11e1d1d1694e3d (127.20.132.194:43625): tablet c59577daf5b2438f92b68a1b3d587c29 (table test-table [id=ce6151ac7db3465c9115586d522ef5b2]) successfully deleted
I20260811 14:25:42.674022 22237 catalog_manager.cc:4841] TS 0e6ffab43d604401a6deb8ae02555635 (127.20.132.195:37249): tablet c59577daf5b2438f92b68a1b3d587c29 (table test-table [id=ce6151ac7db3465c9115586d522ef5b2]) successfully deleted
Aug 11 14:25:42 dist-test-slave-cbbz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458342, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:42.684494 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.674263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58674 (local address 127.20.132.193:38795)
0811 14:25:42.674307 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.674309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.676333 (+ 2024us) server_negotiation.cc:407] Connection header received
0811 14:25:42.676389 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.676390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.676402 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.676451 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:42.677121 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.677663 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.678685 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.678858 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.678908 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.681563 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:42.681572 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:42.681572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:42.681579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:42.683240 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.683633 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.683637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.683637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.683700 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.683912 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.683913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.683913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.684054 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:42.684245 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.684308 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.684392 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 14:25:42.684834 22472 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674
I20260811 14:25:42.692189 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:42.685927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38316 (local address 127.20.132.254:45079)
0811 14:25:42.685980 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:42.685982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:42.685992 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:42.686028 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:42.686029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:42.686039 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:42.686085 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:42.686558 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.687136 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.687909 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:42.688122 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:42.688245 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:42.689461 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:42.689462 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:42.689463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:42.689470 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:42.690995 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.691338 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.691339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.691339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.691397 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:42.691621 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:42.691622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:42.691622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:42.691757 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:42.691870 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:42.691978 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 14:25:42.692051 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 14:25:42.692530 22252 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38316
I20260811 14:25:42.693004 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 22330
I20260811 14:25:42.708050 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 22488
I20260811 14:25:42.715889 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 22644
I20260811 14:25:42.723162 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 22218
2026-08-11T14:25:42Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2576 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:44 dist-test-slave-cbbz krb5kdc[22885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:44 dist-test-slave-cbbz krb5kdc[22885](info): set up 2 sockets
Aug 11 14:25:44 dist-test-slave-cbbz krb5kdc[22885](info): commencing operation
krb5kdc: starting...
W20260811 14:25:45.087432 21011 mini_kdc.cc:121] Time spent starting KDC: real 2.341s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:45.214664 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:38063
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:38063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:45.296077 22900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:45.296382 22900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:45.296406 22900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:45.297502 22900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:45.297534 22900 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 14:25:45.297547 22900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:45.297560 22900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:45.297572 22900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:45.297585 22900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:45.298961 22900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:38063
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:38063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:45.299211 22900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:45.299470 22900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:25:45.304522 22900 server_base.cc:1034] running on GCE node
W20260811 14:25:45.304488 22908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.304495 22905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.304503 22906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:45.304944 22900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:45.305251 22900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:45.306434 22900 hybrid_clock.cc:648] HybridClock initialized: now 1786458345306414 us; error 32 us; skew 500 ppm
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:45.309132 22900 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:45.309580 22900 webserver.cc:460] Webserver started at http://127.20.132.254:33501/ using document root <none> and password file <none>
I20260811 14:25:45.309831 22900 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:45.309876 22900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:45.310027 22900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:45.311067 22900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "77f6550defbf453493d2dfc20efc4784"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "30e5b76249eb955c90004c6ba77170fb"
server_key_iv: "87d8023cc8493e58b84ca6d3d1f58c48"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.311429 22900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "77f6550defbf453493d2dfc20efc4784"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "30e5b76249eb955c90004c6ba77170fb"
server_key_iv: "87d8023cc8493e58b84ca6d3d1f58c48"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.312831 22900 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:45.313524 22915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.313705 22900 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:45.313781 22900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "77f6550defbf453493d2dfc20efc4784"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "30e5b76249eb955c90004c6ba77170fb"
server_key_iv: "87d8023cc8493e58b84ca6d3d1f58c48"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.313831 22900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:45.328454 22900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:45.330565 22900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:45.330673 22900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:45.335204 22900 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:38063
I20260811 14:25:45.335301 22988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:38063 every 8 connection(s)
I20260811 14:25:45.335629 22900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:45.336337 22989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:45.338542 22989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Bootstrap starting.
I20260811 14:25:45.339159 22989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:45.339452 22989 log.cc:824] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:45.339888 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 22900
I20260811 14:25:45.339982 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:45.340181 21011 external_mini_cluster.cc:1428] Setting key 1acf9d4863c1bf76ba2a66418d5b5ad1
I20260811 14:25:45.340250 22989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: No bootstrap required, opened a new log
I20260811 14:25:45.342514 22989 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f6550defbf453493d2dfc20efc4784" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38063 } }
I20260811 14:25:45.342685 22989 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:45.342724 22989 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f6550defbf453493d2dfc20efc4784, State: Initialized, Role: FOLLOWER
I20260811 14:25:45.342887 22989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f6550defbf453493d2dfc20efc4784" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38063 } }
I20260811 14:25:45.342983 22989 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:45.343015 22989 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:45.343066 22989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:45.343736 22989 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f6550defbf453493d2dfc20efc4784" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38063 } }
I20260811 14:25:45.343825 22989 leader_election.cc:302] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77f6550defbf453493d2dfc20efc4784; no voters:
I20260811 14:25:45.344053 22989 leader_election.cc:288] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:45.344072 22995 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:45.344213 22995 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [term 1 LEADER]: Becoming Leader. State: Replica: 77f6550defbf453493d2dfc20efc4784, State: Running, Role: LEADER
I20260811 14:25:45.344297 22995 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f6550defbf453493d2dfc20efc4784" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38063 } }
I20260811 14:25:45.344337 22989 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:45.344617 22995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77f6550defbf453493d2dfc20efc4784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f6550defbf453493d2dfc20efc4784" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38063 } } }
I20260811 14:25:45.344774 22995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:45.344971 22995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77f6550defbf453493d2dfc20efc4784. Latest consensus state: current_term: 1 leader_uuid: "77f6550defbf453493d2dfc20efc4784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f6550defbf453493d2dfc20efc4784" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38063 } } }
I20260811 14:25:45.345146 22995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:45.345572 23003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:45.346158 23003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:45.347738 23003 catalog_manager.cc:1347] Generated new cluster ID: 122cd1526448410aa89ac3869e71adad
I20260811 14:25:45.347791 23003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:45.352437 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.340704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43408 (local address 127.20.132.254:38063)
0811 14:25:45.340876 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.340885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.340918 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:25:45.342498 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.342504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.342551 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.342671 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.343493 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.344807 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.345940 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.346434 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.346565 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.349127 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.349130 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.349131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.349142 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.350841 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.351220 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.351223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.351223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.351330 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.351552 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.351553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.351554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.351794 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.351967 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.352078 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.352255 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260811 14:25:45.354905 23003 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:45.355410 23003 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:45.361105 23003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Generated new TSK 0
I20260811 14:25:45.361286 23003 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:45.393297 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38063
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:45.505553 23019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:45.505748 23019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:45.505772 23019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:45.506927 23019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:45.506973 23019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:45.506994 23019 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 14:25:45.507007 23019 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:25:45.507081 23019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:45.508632 23019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:38063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:45.508891 23019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:45.509140 23019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:45.514569 23025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.514544 23026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.514606 23028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:45.514726 23019 server_base.cc:1034] running on GCE node
I20260811 14:25:45.515007 23019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:45.515277 23019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:45.516454 23019 hybrid_clock.cc:648] HybridClock initialized: now 1786458345516425 us; error 40 us; skew 500 ppm
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:45.519266 23019 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:45.519727 23019 webserver.cc:460] Webserver started at http://127.20.132.193:46271/ using document root <none> and password file <none>
I20260811 14:25:45.519933 23019 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:45.519973 23019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:45.520064 23019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:45.521167 23019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "73c384149a9a4c7ab403bc368ef6dc85"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "ccf06747fc08f96a45b31e924d2d897c"
server_key_iv: "5dc8969a2e2d55f2fc5abaffcd505306"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.521466 23019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "73c384149a9a4c7ab403bc368ef6dc85"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "ccf06747fc08f96a45b31e924d2d897c"
server_key_iv: "5dc8969a2e2d55f2fc5abaffcd505306"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.522778 23019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:25:45.523481 23035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.523667 23019 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:45.523773 23019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "73c384149a9a4c7ab403bc368ef6dc85"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "ccf06747fc08f96a45b31e924d2d897c"
server_key_iv: "5dc8969a2e2d55f2fc5abaffcd505306"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.523859 23019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:45.542377 23019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:45.544684 23019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:45.544895 23019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:45.545511 23019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:45.545579 23019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.545631 23019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:45.545658 23019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:45.553484 23019 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:36035
I20260811 14:25:45.553583 23165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:36035 every 8 connection(s)
I20260811 14:25:45.553938 23019 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:25:45.556609 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.546038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:40287 (local address 127.20.132.254:38063)
0811 14:25:45.546129 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.546132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.546342 (+ 210us) server_negotiation.cc:407] Connection header received
0811 14:25:45.546853 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.546855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.546870 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.546953 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.547869 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.548747 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.549986 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.550365 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.550453 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.553394 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.553396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.553396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.553404 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.555083 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.555517 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.555518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.555519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.555576 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.555833 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.555834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.555834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.555972 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.556098 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.556432 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.556520 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:25:45.556802 23046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.546027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.20.132.193:40287)
0811 14:25:45.546220 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.546262 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.546750 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.547090 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.547095 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.547459 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:45.547774 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.547781 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.548887 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.548888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.549872 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.549875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.550490 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.550492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.550631 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.551136 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:45.551145 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:45.553288 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:45.555188 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.555195 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.555197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.555425 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.555657 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.555657 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.555658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.555762 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.556084 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:45.556092 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:45.556278 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.556408 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.556568 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":123,"threads_started":1}
I20260811 14:25:45.557348 23166 heartbeater.cc:347] Connected to a master server at 127.20.132.254:38063
I20260811 14:25:45.557430 23166 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:45.557619 23166 heartbeater.cc:511] Master 127.20.132.254:38063 requested a full tablet report, sending...
I20260811 14:25:45.558174 22933 ts_manager.cc:194] Registered new tserver with Master: 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035)
I20260811 14:25:45.559124 22933 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:40287
I20260811 14:25:45.559710 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 23019
I20260811 14:25:45.559824 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:45.559981 21011 external_mini_cluster.cc:1428] Setting key e6da4d6dd622d3406f9934b86707a356
I20260811 14:25:45.564447 23173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.558368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.20.132.193:57525)
0811 14:25:45.558492 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.558504 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.558565 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.558675 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.558676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.558867 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:45.558923 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.558924 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.559765 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.559766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.560453 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.560455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.560861 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.560862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.560923 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.561336 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:45.561340 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:45.561606 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:45.563219 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.563220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.563221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.563481 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.563703 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.563704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.563705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.563770 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.564087 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:45.564088 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:45.564199 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.564292 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.564381 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260811 14:25:45.564566 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.558467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:57525 (local address 127.20.132.254:38063)
0811 14:25:45.558505 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.558507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.558550 (+ 43us) server_negotiation.cc:407] Connection header received
0811 14:25:45.558619 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.558620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.558627 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.558670 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.558986 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.559655 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.560536 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.560779 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.560859 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.561694 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.561695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.561695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.561703 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.563135 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.563563 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.563564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.563565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.563626 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.563839 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.563839 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.563840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.563982 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.564052 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.564343 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.564432 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:45.588217 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38063
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:45.681099 23176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:45.681308 23176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:45.681332 23176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:45.682533 23176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:45.682614 23176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:45.682675 23176 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 14:25:45.682698 23176 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:25:45.682739 23176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:45.684314 23176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:38063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:45.684557 23176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:45.684798 23176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:45.689949 23185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.689975 23183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:45.690193 23176 server_base.cc:1034] running on GCE node
W20260811 14:25:45.689949 23182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:45.690464 23176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:45.690745 23176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:45.691939 23176 hybrid_clock.cc:648] HybridClock initialized: now 1786458345691916 us; error 43 us; skew 500 ppm
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:45.694686 23176 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:45.695202 23176 webserver.cc:460] Webserver started at http://127.20.132.194:43773/ using document root <none> and password file <none>
I20260811 14:25:45.695444 23176 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:45.695521 23176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:45.695673 23176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:45.696868 23176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "789f6d345476427c87202223fc10597f"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "1ebe7b4dc4cec30ff893fc3a619af67c"
server_key_iv: "7af3a96acdb96021074c58fd99c87265"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.697296 23176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "789f6d345476427c87202223fc10597f"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "1ebe7b4dc4cec30ff893fc3a619af67c"
server_key_iv: "7af3a96acdb96021074c58fd99c87265"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.698768 23176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:25:45.699623 23192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.699827 23176 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:45.699935 23176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "789f6d345476427c87202223fc10597f"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "1ebe7b4dc4cec30ff893fc3a619af67c"
server_key_iv: "7af3a96acdb96021074c58fd99c87265"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.700026 23176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:45.719923 23176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:45.722266 23176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:45.722465 23176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:45.723109 23176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:45.723176 23176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.723219 23176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:45.723243 23176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:45.731154 23176 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:40443
I20260811 14:25:45.731242 23320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:40443 every 8 connection(s)
I20260811 14:25:45.731616 23176 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:45.733491 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 23176
I20260811 14:25:45.733637 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:45.733812 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.723560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:51967 (local address 127.20.132.254:38063)
0811 14:25:45.723641 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.723643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.723846 (+ 203us) server_negotiation.cc:407] Connection header received
0811 14:25:45.724409 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.724411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.724427 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.724517 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.725129 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.726003 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.727235 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.727452 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.727538 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.730779 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.730781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.730781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.730788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.732502 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.732913 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.732914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.732914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.732974 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.733163 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.733163 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.733163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.733262 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.733310 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.733614 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.733705 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:25:45.733829 23202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.723543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.20.132.194:51967)
0811 14:25:45.723708 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.723749 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.724303 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.724568 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.724571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.724821 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:45.725013 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.725017 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.726140 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.726142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.727133 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.727136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.727545 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.727547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.727684 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.728426 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:45.728435 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:45.730677 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:45.732610 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.732616 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.732618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.732843 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.733017 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.733017 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.733017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.733116 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.733332 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:45.733335 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:45.733446 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.733532 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.733663 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260811 14:25:45.733842 21011 external_mini_cluster.cc:1428] Setting key 34945167eee4e925d2b9d6104bb0dc56
I20260811 14:25:45.734403 23321 heartbeater.cc:347] Connected to a master server at 127.20.132.254:38063
I20260811 14:25:45.734524 23321 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:45.734752 23321 heartbeater.cc:511] Master 127.20.132.254:38063 requested a full tablet report, sending...
I20260811 14:25:45.736501 22934 ts_manager.cc:194] Registered new tserver with Master: 789f6d345476427c87202223fc10597f (127.20.132.194:40443)
I20260811 14:25:45.737047 22934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:51967
I20260811 14:25:45.741797 23327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.735616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.20.132.194:34827)
0811 14:25:45.735778 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.735793 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.735844 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.735974 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.735975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.736129 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:45.736244 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.736245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.736982 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.736983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.737658 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.737660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.738065 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.738066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.738145 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.738623 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:45.738628 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:45.738893 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:45.740658 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.740659 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.740659 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.740836 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.741056 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.741057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.741057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.741118 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.741435 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:45.741436 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:45.741482 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.741565 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.741680 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260811 14:25:45.741791 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.735687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:34827 (local address 127.20.132.254:38063)
0811 14:25:45.735731 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.735733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.735881 (+ 148us) server_negotiation.cc:407] Connection header received
0811 14:25:45.735903 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.735904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.735915 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.735971 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.736336 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.736885 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.737765 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.737972 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.738062 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.738993 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.738994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.738995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.739002 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.740559 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.740918 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.740919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.740919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.740976 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.741201 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.741202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.741203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.741352 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.741430 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.741603 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.741678 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:45.763863 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38063
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:45.848541 23330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:45.848734 23330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:45.848759 23330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:45.849857 23330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:45.849893 23330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:45.849915 23330 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 14:25:45.849926 23330 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:25:45.849942 23330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:45.851426 23330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:38063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:45.851613 23330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:45.851780 23330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:45.856925 23336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.856940 23335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:45.856935 23339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:45.857213 23330 server_base.cc:1034] running on GCE node
I20260811 14:25:45.857419 23330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:45.857749 23330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:45.858906 23330 hybrid_clock.cc:648] HybridClock initialized: now 1786458345858896 us; error 28 us; skew 500 ppm
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:45.861752 23330 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:45.862315 23330 webserver.cc:460] Webserver started at http://127.20.132.195:46395/ using document root <none> and password file <none>
I20260811 14:25:45.862579 23330 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:45.862632 23330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:45.862819 23330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:45.863960 23330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "c0a620dc925e468a94b5c6aa019504c0"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "2bcfadaf38299ea444cc4767252b0f16"
server_key_iv: "b8b5c6bf0883cea2177b5cc8857296b4"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.864409 23330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "c0a620dc925e468a94b5c6aa019504c0"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "2bcfadaf38299ea444cc4767252b0f16"
server_key_iv: "b8b5c6bf0883cea2177b5cc8857296b4"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.865768 23330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:45.866503 23346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.866740 23330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:45.866815 23330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "c0a620dc925e468a94b5c6aa019504c0"
format_stamp: "Formatted at 2026-08-11 14:25:45 on dist-test-slave-cbbz"
server_key: "2bcfadaf38299ea444cc4767252b0f16"
server_key_iv: "b8b5c6bf0883cea2177b5cc8857296b4"
server_key_version: "encryptionkey@0"
I20260811 14:25:45.866868 23330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:45.895232 23330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:45.897303 23330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:45.897413 23330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:45.897922 23330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:45.897965 23330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:45.897991 23330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:45.898005 23330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:45.906081 23330 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:41527
I20260811 14:25:45.906230 23479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:41527 every 8 connection(s)
I20260811 14:25:45.906499 23330 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:45.908948 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.898550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:59069 (local address 127.20.132.254:38063)
0811 14:25:45.898613 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.898615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.898853 (+ 238us) server_negotiation.cc:407] Connection header received
0811 14:25:45.899343 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.899345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.899360 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.899436 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.900409 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.900971 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.902547 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.902918 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.903005 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.906175 (+ 3170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.906177 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.906177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.906185 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.907705 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.908100 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.908101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.908101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.908241 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.908471 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.908472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.908472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.908578 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.908637 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.908824 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.908884 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:25:45.909200 23359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.898524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.20.132.195:59069)
0811 14:25:45.898700 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.898736 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.899238 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.899505 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.899508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.899884 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:45.900289 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.900295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.901079 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.901079 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.902445 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.902449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.903042 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.903043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.903217 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.903793 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:45.903803 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:45.906050 (+ 2247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:45.907782 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.907787 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.907788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.908006 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.908309 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.908309 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.908310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.908410 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.908630 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:45.908632 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:45.908737 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.908812 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.908931 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260811 14:25:45.909397 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 23330
I20260811 14:25:45.909484 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:45.909682 21011 external_mini_cluster.cc:1428] Setting key 01e587851203b48e6ee66d4d0f01253c
I20260811 14:25:45.909814 23481 heartbeater.cc:347] Connected to a master server at 127.20.132.254:38063
I20260811 14:25:45.909915 23481 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:45.910092 23481 heartbeater.cc:511] Master 127.20.132.254:38063 requested a full tablet report, sending...
I20260811 14:25:45.910444 22934 ts_manager.cc:194] Registered new tserver with Master: c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:45.910987 22934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:59069
I20260811 14:25:45.916458 23488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.910782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.20.132.195:57371)
0811 14:25:45.911326 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.911335 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.911394 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.911519 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.911520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.911680 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:45.911738 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.911740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.912482 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.912482 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.912978 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.912979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.913307 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.913308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.913363 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.913696 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:45.913700 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:45.913957 (+ 257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:45.915509 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.915509 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.915509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.915665 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.915848 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:45.915848 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:45.915849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:45.915898 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:45.916195 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:45.916196 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:45.916243 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.916314 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.916397 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":66,"threads_started":1}
I20260811 14:25:45.916469 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.910849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:57371 (local address 127.20.132.254:38063)
0811 14:25:45.910886 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.910887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.911380 (+ 493us) server_negotiation.cc:407] Connection header received
0811 14:25:45.911448 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.911449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.911459 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.911516 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.911816 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.912395 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.913064 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.913240 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.913289 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.914056 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.914057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.914058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.914063 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.915437 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.915736 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.915737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.915737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.915786 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.915964 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.915964 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.915965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.916093 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.916211 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.916351 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.916415 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:25:45.921360 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:25:45 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:45.945276 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.937974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.20.132.254:38063)
0811 14:25:45.938062 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.938064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.938073 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:45.938097 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.938098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.938108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.938158 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:45.938734 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.939227 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.939966 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.940264 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.940329 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.942562 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:45.942563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:45.942564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:45.942572 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:45.944017 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.944429 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.944430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.944431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.944493 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:45.944724 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:45.944725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:45.944725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:45.944861 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:45.944976 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.945084 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.945167 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:25:45.947127 22934 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:45.948850 22934 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:45.955708 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.951703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.20.132.194:40443)
0811 14:25:45.952244 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.952248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.952257 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:45.952296 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.952297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.952313 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.952388 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:45.952496 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.953168 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.954771 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.955283 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.955383 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.955444 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.955560 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.955600 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":81,"threads_started":1}
I20260811 14:25:45.955685 23505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.951475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:40443 (local address 127.0.0.1:51526)
0811 14:25:45.951838 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.951849 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.951899 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.952384 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.952385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.952387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:45.952430 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.952431 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.953263 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.953265 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.954709 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.954711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.955380 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.955381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.955457 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.955471 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.955544 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.955595 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":58,"thread_start_us":75,"threads_started":1}
I20260811 14:25:45.955863 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.951277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:41527 (local address 127.0.0.1:49148)
0811 14:25:45.951709 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.951720 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.951768 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.952075 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.952076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.952078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:45.952167 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.952169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.953437 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.953438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.954628 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.954631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.955584 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.955585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.955656 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.955661 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.955725 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.955764 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":2,"thread_start_us":57,"threads_started":1}
I20260811 14:25:45.956120 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.951416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47398 (local address 127.20.132.193:36035)
0811 14:25:45.951620 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.951624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.951637 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:25:45.951683 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.951685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.951704 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.951791 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:45.952022 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.953369 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.954609 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.955415 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.955492 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.955545 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.955904 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.956021 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":102,"threads_started":1}
I20260811 14:25:45.956208 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.951626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49148 (local address 127.20.132.195:41527)
0811 14:25:45.951913 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:45.951917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:45.951926 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:45.951956 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:45.951958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:45.951996 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:45.952078 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:45.952248 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.953345 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.954729 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.955414 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.955493 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.955545 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:45.955987 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 14:25:45.956041 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":108,"threads_started":1}
I20260811 14:25:45.956560 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:45.951276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36035 (local address 127.0.0.1:47398)
0811 14:25:45.951436 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:45.951476 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:45.951540 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:45.951881 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:45.951884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:45.951887 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:45.951957 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.951959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.953460 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.953461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.954498 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:45.954501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:45.955591 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:45.955592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:45.955666 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:45.955670 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:45.955728 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 14:25:45.956481 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":18,"thread_start_us":72,"threads_started":1}
I20260811 14:25:45.956645 23247 tablet_service.cc:1467] Processing CreateTablet for tablet 97017fd58e174fde80040ec1cdb0c4a3 (DEFAULT_TABLE table=test-table [id=5ce5d42780d545d4a7943bc6433a8077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:45.956828 23405 tablet_service.cc:1467] Processing CreateTablet for tablet 97017fd58e174fde80040ec1cdb0c4a3 (DEFAULT_TABLE table=test-table [id=5ce5d42780d545d4a7943bc6433a8077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:45.957046 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97017fd58e174fde80040ec1cdb0c4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:45.957145 23405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97017fd58e174fde80040ec1cdb0c4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:45.960554 23092 tablet_service.cc:1467] Processing CreateTablet for tablet 97017fd58e174fde80040ec1cdb0c4a3 (DEFAULT_TABLE table=test-table [id=5ce5d42780d545d4a7943bc6433a8077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:45.960764 23510 tablet_bootstrap.cc:492] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Bootstrap starting.
I20260811 14:25:45.960794 23509 tablet_bootstrap.cc:492] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Bootstrap starting.
I20260811 14:25:45.960954 23092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97017fd58e174fde80040ec1cdb0c4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:45.961513 23510 tablet_bootstrap.cc:654] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:45.961694 23509 tablet_bootstrap.cc:654] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:45.961949 23510 log.cc:824] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:45.962075 23509 log.cc:824] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:45.962757 23510 tablet_bootstrap.cc:492] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: No bootstrap required, opened a new log
I20260811 14:25:45.962841 23510 ts_tablet_manager.cc:1397] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:25:45.963069 23509 tablet_bootstrap.cc:492] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: No bootstrap required, opened a new log
I20260811 14:25:45.963142 23509 ts_tablet_manager.cc:1397] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:25:45.964291 23514 tablet_bootstrap.cc:492] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Bootstrap starting.
I20260811 14:25:45.964946 23514 tablet_bootstrap.cc:654] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:45.965093 23510 raft_consensus.cc:348] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:45.965284 23510 raft_consensus.cc:374] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:45.965206 23509 raft_consensus.cc:348] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:45.965320 23510 raft_consensus.cc:729] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789f6d345476427c87202223fc10597f, State: Initialized, Role: FOLLOWER
I20260811 14:25:45.965332 23509 raft_consensus.cc:374] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:45.965315 23514 log.cc:824] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:45.965365 23509 raft_consensus.cc:729] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a620dc925e468a94b5c6aa019504c0, State: Initialized, Role: FOLLOWER
I20260811 14:25:45.965469 23509 consensus_queue.cc:260] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:45.965471 23510 consensus_queue.cc:260] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:45.965739 23510 ts_tablet_manager.cc:1428] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:25:45.965739 23509 ts_tablet_manager.cc:1428] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:25:45.965857 23321 heartbeater.cc:503] Master 127.20.132.254:38063 was elected leader, sending a full tablet report...
I20260811 14:25:45.965920 23481 heartbeater.cc:503] Master 127.20.132.254:38063 was elected leader, sending a full tablet report...
I20260811 14:25:45.966136 23514 tablet_bootstrap.cc:492] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: No bootstrap required, opened a new log
I20260811 14:25:45.966210 23514 ts_tablet_manager.cc:1397] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:25:45.967938 23514 raft_consensus.cc:348] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:45.968062 23514 raft_consensus.cc:374] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:45.968091 23514 raft_consensus.cc:729] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Initialized, Role: FOLLOWER
I20260811 14:25:45.968267 23514 consensus_queue.cc:260] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:45.968583 23514 ts_tablet_manager.cc:1428] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 14:25:45.968600 23166 heartbeater.cc:503] Master 127.20.132.254:38063 was elected leader, sending a full tablet report...
W20260811 14:25:45.982867 23322 tablet.cc:2369] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:25:46.054772 23167 tablet.cc:2369] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:25:46.157147 23482 tablet.cc:2369] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:25:46.183166 23518 raft_consensus.cc:482] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:46.183296 23518 raft_consensus.cc:504] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:46.183705 23518 leader_election.cc:288] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527), 789f6d345476427c87202223fc10597f (127.20.132.194:40443)
I20260811 14:25:46.186403 23516 raft_consensus.cc:482] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:46.186523 23516 raft_consensus.cc:504] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:46.186880 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.184098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:45271 (local address 127.20.132.195:41527)
0811 14:25:46.184178 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.184181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.184195 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:25:46.184301 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.184303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.184314 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.184363 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:46.184560 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.185079 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.186064 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.186569 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.186638 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.186647 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.186773 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.186810 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:25:46.187065 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.184320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:40375 (local address 127.20.132.194:40443)
0811 14:25:46.184401 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.184403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.184412 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:46.184442 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.184443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.184451 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.184524 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:46.184702 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.185217 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.186149 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.186642 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.186713 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.186723 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.186926 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.186976 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:25:46.187269 23519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.183951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:41527 (local address 127.20.132.193:45271)
0811 14:25:46.184116 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.184129 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.184215 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.184396 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.184398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.184401 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:46.184479 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.184481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.185201 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.185202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.185962 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.185964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.186638 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.186639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.186712 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.186716 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.186766 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.186810 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260811 14:25:46.186892 23516 leader_election.cc:288] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), 789f6d345476427c87202223fc10597f (127.20.132.194:40443)
I20260811 14:25:46.187479 23520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.184144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:40443 (local address 127.20.132.193:40375)
0811 14:25:46.184271 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.184280 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.184320 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.184530 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.184531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.184534 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:46.184623 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.184625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.185321 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.185322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.186046 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.186048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.186760 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.186761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.186834 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.186838 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.187155 (+ 317us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.187215 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260811 14:25:46.187825 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97017fd58e174fde80040ec1cdb0c4a3" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0" is_pre_election: true
I20260811 14:25:46.187922 23428 raft_consensus.cc:2454] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 0.
I20260811 14:25:46.187927 23269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97017fd58e174fde80040ec1cdb0c4a3" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789f6d345476427c87202223fc10597f" is_pre_election: true
I20260811 14:25:46.188056 23269 raft_consensus.cc:2454] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 0.
I20260811 14:25:46.188295 23040 leader_election.cc:302] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73c384149a9a4c7ab403bc368ef6dc85, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:46.188511 23518 raft_consensus.cc:2781] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:46.188592 23518 raft_consensus.cc:482] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:46.188618 23518 raft_consensus.cc:3037] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.189484 23518 raft_consensus.cc:504] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:46.189697 23518 leader_election.cc:288] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 election: Requested vote from peers c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527), 789f6d345476427c87202223fc10597f (127.20.132.194:40443)
I20260811 14:25:46.189890 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97017fd58e174fde80040ec1cdb0c4a3" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0"
I20260811 14:25:46.189950 23269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97017fd58e174fde80040ec1cdb0c4a3" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789f6d345476427c87202223fc10597f"
I20260811 14:25:46.189968 23428 raft_consensus.cc:3037] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.190033 23269 raft_consensus.cc:3037] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.190078 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.187261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:37267 (local address 127.20.132.193:36035)
0811 14:25:46.187314 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.187316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.187324 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:25:46.187345 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.187345 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.187354 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.187412 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:46.187542 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.188204 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.189272 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.189677 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.189745 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.189752 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.189993 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.190027 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 14:25:46.190239 23359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.186987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36035 (local address 127.20.132.195:37267)
0811 14:25:46.187065 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.187073 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.187105 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.187424 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.187425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.187426 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:46.187483 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.187484 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.188290 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.188290 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.189170 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.189172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.189783 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.189784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.189867 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.189870 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.189915 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.189950 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 14:25:46.190536 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.187304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:55475 (local address 127.20.132.194:40443)
0811 14:25:46.187416 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.187418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.187425 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:25:46.187445 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.187446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.187454 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.187503 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:46.187765 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.188422 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.189621 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.190143 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.190212 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.190219 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.190444 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.190477 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 14:25:46.190763 23521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.187024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:40443 (local address 127.20.132.195:55475)
0811 14:25:46.187274 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.187284 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.187332 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.187513 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.187514 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.187516 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:46.187584 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.187586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.188491 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.188493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.189520 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.189523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.190268 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.190269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.190346 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.190350 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.190435 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.190474 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":118,"threads_started":1}
I20260811 14:25:46.190879 23269 raft_consensus.cc:2454] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 1.
I20260811 14:25:46.190879 23428 raft_consensus.cc:2454] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 1.
I20260811 14:25:46.191073 23040 leader_election.cc:302] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73c384149a9a4c7ab403bc368ef6dc85, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:46.191160 23518 raft_consensus.cc:2781] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:46.191213 23269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97017fd58e174fde80040ec1cdb0c4a3" candidate_uuid: "c0a620dc925e468a94b5c6aa019504c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789f6d345476427c87202223fc10597f" is_pre_election: true
I20260811 14:25:46.191277 23518 raft_consensus.cc:686] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 LEADER]: Becoming Leader. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Running, Role: LEADER
I20260811 14:25:46.191309 23269 raft_consensus.cc:2379] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0a620dc925e468a94b5c6aa019504c0 in current term 1: Already voted for candidate 73c384149a9a4c7ab403bc368ef6dc85 in this term.
I20260811 14:25:46.191362 23518 consensus_queue.cc:237] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } }
I20260811 14:25:46.191398 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97017fd58e174fde80040ec1cdb0c4a3" candidate_uuid: "c0a620dc925e468a94b5c6aa019504c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85" is_pre_election: true
I20260811 14:25:46.191684 23347 leader_election.cc:302] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0a620dc925e468a94b5c6aa019504c0; no voters: 73c384149a9a4c7ab403bc368ef6dc85, 789f6d345476427c87202223fc10597f
I20260811 14:25:46.191869 23516 raft_consensus.cc:2726] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 14:25:46.192257 22933 catalog_manager.cc:5495] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "73c384149a9a4c7ab403bc368ef6dc85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } health_report { overall_health: UNKNOWN } } }
Aug 11 14:25:46 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458345, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:46.267722 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.260853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38063 (local address 127.0.0.1:43424)
0811 14:25:46.261061 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.261072 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.261166 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.261344 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.261345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.261671 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:46.261722 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.261725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.262421 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.262422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.262961 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.262963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.263369 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.263369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.263426 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.263931 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:46.263935 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:46.265368 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:46.266761 (+ 1393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:46.266768 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:46.266770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:46.266970 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:46.267159 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:46.267160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:46.267160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:46.267220 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:46.267440 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:46.267446 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:46.267490 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.267544 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.267645 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":126,"threads_started":1}
I20260811 14:25:46.267829 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.260944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.20.132.254:38063)
0811 14:25:46.261039 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.261042 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.261152 (+ 110us) server_negotiation.cc:407] Connection header received
0811 14:25:46.261253 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.261254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.261265 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.261339 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:46.261844 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.262335 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.263089 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.263279 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.263368 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.265449 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:46.265450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:46.265451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:46.265457 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:46.266683 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:46.267043 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:46.267044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:46.267044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:46.267093 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:46.267279 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:46.267279 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:46.267280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:46.267380 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:46.267432 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.267577 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.267700 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":60}
I20260811 14:25:46.269868 22933 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:43424:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 14:25:46.270102 22933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:46.271744 23092 tablet_service.cc:1467] Processing CreateTablet for tablet 212fe09b1db947349692ae1ca6f19040 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1bb9a8e5a4074968a8902158861ef838]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:25:46.271745 23247 tablet_service.cc:1467] Processing CreateTablet for tablet 212fe09b1db947349692ae1ca6f19040 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1bb9a8e5a4074968a8902158861ef838]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:25:46.271924 23092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 212fe09b1db947349692ae1ca6f19040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:46.271924 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 212fe09b1db947349692ae1ca6f19040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:46.272327 23405 tablet_service.cc:1467] Processing CreateTablet for tablet 212fe09b1db947349692ae1ca6f19040 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1bb9a8e5a4074968a8902158861ef838]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:25:46.272503 23405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 212fe09b1db947349692ae1ca6f19040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:46.273518 23514 tablet_bootstrap.cc:492] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: Bootstrap starting.
I20260811 14:25:46.273988 23514 tablet_bootstrap.cc:654] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:46.273999 23509 tablet_bootstrap.cc:492] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: Bootstrap starting.
I20260811 14:25:46.274396 23509 tablet_bootstrap.cc:654] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:46.274549 23510 tablet_bootstrap.cc:492] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: Bootstrap starting.
I20260811 14:25:46.274952 23510 tablet_bootstrap.cc:654] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:46.275142 23509 tablet_bootstrap.cc:492] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: No bootstrap required, opened a new log
I20260811 14:25:46.275188 23509 ts_tablet_manager.cc:1397] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:46.275381 23509 raft_consensus.cc:348] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.275457 23514 tablet_bootstrap.cc:492] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: No bootstrap required, opened a new log
I20260811 14:25:46.275507 23509 raft_consensus.cc:374] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:46.275507 23514 ts_tablet_manager.cc:1397] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:25:46.275544 23509 raft_consensus.cc:729] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a620dc925e468a94b5c6aa019504c0, State: Initialized, Role: FOLLOWER
I20260811 14:25:46.275585 23509 consensus_queue.cc:260] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.275606 23510 tablet_bootstrap.cc:492] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: No bootstrap required, opened a new log
I20260811 14:25:46.275648 23510 ts_tablet_manager.cc:1397] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:46.275687 23509 ts_tablet_manager.cc:1428] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:46.275681 23514 raft_consensus.cc:348] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.275802 23514 raft_consensus.cc:374] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:46.275830 23514 raft_consensus.cc:729] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Initialized, Role: FOLLOWER
I20260811 14:25:46.275840 23510 raft_consensus.cc:348] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.275858 23516 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.275877 23514 consensus_queue.cc:260] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.275911 23510 raft_consensus.cc:374] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:46.275934 23510 raft_consensus.cc:729] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789f6d345476427c87202223fc10597f, State: Initialized, Role: FOLLOWER
I20260811 14:25:46.275928 23516 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.275985 23514 ts_tablet_manager.cc:1428] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:46.275983 23510 consensus_queue.cc:260] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.276088 23510 ts_tablet_manager.cc:1428] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:46.276263 23517 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.276345 23517 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.276152 23518 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.276602 23518 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.311653 23517 raft_consensus.cc:482] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:46.311749 23517 raft_consensus.cc:504] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.312197 23517 leader_election.cc:288] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:46.315114 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.312467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:36073 (local address 127.20.132.195:41527)
0811 14:25:46.312531 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.312533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.312573 (+ 40us) server_negotiation.cc:407] Connection header received
0811 14:25:46.312645 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.312647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.312660 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.312724 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:46.312895 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.313385 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.314376 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.314735 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.314823 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.314833 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.315009 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.315048 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 14:25:46.315127 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.312359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:41527 (local address 127.20.132.194:36073)
0811 14:25:46.312514 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.312526 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.312591 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.312750 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.312751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.312754 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:46.312813 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.312814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.313490 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.313491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.314273 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.314275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.314857 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.314858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.314926 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.314929 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.315003 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.315044 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":71,"threads_started":1}
I20260811 14:25:46.315407 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "212fe09b1db947349692ae1ca6f19040" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0" is_pre_election: true
I20260811 14:25:46.315502 23428 raft_consensus.cc:2454] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 0.
I20260811 14:25:46.315501 23536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.312381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36035 (local address 127.20.132.194:50351)
0811 14:25:46.312531 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.312543 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.312612 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.312766 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.312767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.312769 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:46.313169 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.313171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.313821 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.313822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.314508 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.314510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.315068 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.315069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.315128 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.315131 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.315368 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.315409 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260811 14:25:46.315503 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.312474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:50351 (local address 127.20.132.193:36035)
0811 14:25:46.312549 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.312564 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.312624 (+ 60us) server_negotiation.cc:407] Connection header received
0811 14:25:46.312674 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.312675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.312685 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.312761 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:46.313257 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.313727 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.314608 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.314969 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.315060 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.315068 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.315379 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.315436 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:25:46.315747 23196 leader_election.cc:302] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789f6d345476427c87202223fc10597f, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:46.315872 23517 raft_consensus.cc:2781] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:46.315837 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "212fe09b1db947349692ae1ca6f19040" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85" is_pre_election: true
I20260811 14:25:46.315915 23517 raft_consensus.cc:482] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:46.315941 23517 raft_consensus.cc:3037] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.315938 23114 raft_consensus.cc:2454] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 0.
I20260811 14:25:46.316885 23517 raft_consensus.cc:504] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.317050 23517 leader_election.cc:288] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 election: Requested vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:46.317241 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "212fe09b1db947349692ae1ca6f19040" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85"
I20260811 14:25:46.317237 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "212fe09b1db947349692ae1ca6f19040" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0"
I20260811 14:25:46.317319 23428 raft_consensus.cc:3037] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.317319 23114 raft_consensus.cc:3037] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.318089 23428 raft_consensus.cc:2454] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 1.
I20260811 14:25:46.318140 23114 raft_consensus.cc:2454] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 1.
I20260811 14:25:46.318307 23193 leader_election.cc:302] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73c384149a9a4c7ab403bc368ef6dc85, 789f6d345476427c87202223fc10597f; no voters:
I20260811 14:25:46.318416 23517 raft_consensus.cc:2781] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:46.318570 23517 raft_consensus.cc:686] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [term 1 LEADER]: Becoming Leader. State: Replica: 789f6d345476427c87202223fc10597f, State: Running, Role: LEADER
I20260811 14:25:46.318665 23517 consensus_queue.cc:237] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.319131 23538 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: TxnStatusTablet state changed. Reason: New leader 789f6d345476427c87202223fc10597f. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.319206 23538 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:25:46.319490 23540 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 14:25:46.319450 22934 catalog_manager.cc:5495] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f reported cstate change: term changed from 0 to 1, leader changed from <none> to 789f6d345476427c87202223fc10597f (127.20.132.194). New cstate: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } health_report { overall_health: UNKNOWN } } }
I20260811 14:25:46.319591 23540 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 14:25:46.337381 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.334077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.20.132.194:40443)
0811 14:25:46.334120 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.334123 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.334134 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:25:46.334208 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.334209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.334228 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.334323 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:46.334457 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.335269 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.336415 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.336721 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.336795 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.337000 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.337114 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.337200 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.337290 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.337309 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:25:46.337389 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.333973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:40443 (local address 127.0.0.1:51530)
0811 14:25:46.334049 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.334062 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.334118 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.334304 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.334305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.334306 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:46.334382 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.334384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.335360 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.335361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.336317 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.336320 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.336812 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.336813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.336882 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.336896 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.337193 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.337203 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.337264 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.337315 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 14:25:46.339416 23114 raft_consensus.cc:1261] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Refusing update from remote peer 789f6d345476427c87202223fc10597f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:46.339432 23428 raft_consensus.cc:1261] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Refusing update from remote peer 789f6d345476427c87202223fc10597f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:46.339706 23517 consensus_queue.cc:1035] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [LEADER]: Connected to new peer: Peer: permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:46.339929 23538 consensus_queue.cc:1035] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:46.340967 23518 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: TxnStatusTablet state changed. Reason: New leader 789f6d345476427c87202223fc10597f. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.341064 23518 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.342099 23516 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: TxnStatusTablet state changed. Reason: New leader 789f6d345476427c87202223fc10597f. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.342212 23516 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.342700 23545 mvcc.cc:205] Tried to move back new op lower bound from 7317333386603794432 to 7317333386521788416. Current Snapshot: MvccSnapshot[applied={T|T < 7317333386603794432}]
I20260811 14:25:46.342849 23538 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.342923 23538 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:25:46.342973 23538 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.343029 23538 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 789f6d345476427c87202223fc10597f: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:25:46.343751 23518 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.343843 23518 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P 73c384149a9a4c7ab403bc368ef6dc85: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.343899 23546 mvcc.cc:205] Tried to move back new op lower bound from 7317333386603794432 to 7317333386521788416. Current Snapshot: MvccSnapshot[applied={T|T < 7317333386603794432}]
I20260811 14:25:46.344202 23516 tablet_replica.cc:439] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } } }
I20260811 14:25:46.344280 23516 tablet_replica.cc:442] T 212fe09b1db947349692ae1ca6f19040 P c0a620dc925e468a94b5c6aa019504c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:25:46.345089 23548 mvcc.cc:205] Tried to move back new op lower bound from 7317333386603794432 to 7317333386521788416. Current Snapshot: MvccSnapshot[applied={T|T < 7317333386603794432 or (T in {7317333386603794432})}]
I20260811 14:25:46.349030 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.345939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47412 (local address 127.20.132.193:36035)
0811 14:25:46.345978 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.345979 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.345986 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:25:46.346014 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.346015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.346032 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.346127 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:46.346311 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.347321 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.348071 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.348402 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.348473 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.348633 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.348746 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.348826 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.348932 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.348953 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:25:46.354123 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.351615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:59805 (local address 127.20.132.194:40443)
0811 14:25:46.351664 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.351666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.351758 (+ 92us) server_negotiation.cc:407] Connection header received
0811 14:25:46.351807 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.351807 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.351817 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.351890 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:46.352049 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.352571 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.353373 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.353596 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.353678 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.353865 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.353900 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.353971 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.354033 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.354053 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 14:25:46.354182 23558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.351514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:40443 (local address 127.20.132.193:59805)
0811 14:25:46.351673 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.351685 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.351746 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.351894 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.351895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.351896 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:46.351968 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.351970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.352665 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.352666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.353279 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.353281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.353678 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.353679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.353746 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.353761 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.353973 (+ 212us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.353975 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.354030 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.354075 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260811 14:25:46.357242 23269 raft_consensus.cc:1261] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Refusing update from remote peer 73c384149a9a4c7ab403bc368ef6dc85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:46.357460 23428 raft_consensus.cc:1261] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Refusing update from remote peer 73c384149a9a4c7ab403bc368ef6dc85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:46.357535 23522 consensus_queue.cc:1035] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:46.357663 23518 consensus_queue.cc:1035] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:46.366569 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.363620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:51565 (local address 127.20.132.193:36035)
0811 14:25:46.363680 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.363682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.363779 (+ 97us) server_negotiation.cc:407] Connection header received
0811 14:25:46.363846 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.363847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.363857 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.363917 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:46.364210 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.364810 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.365608 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.365820 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.365911 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.366233 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.366273 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.366380 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.366453 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.366477 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:25:46.366956 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.363541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36035 (local address 127.20.132.194:51565)
0811 14:25:46.363696 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.363707 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.363793 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.363921 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.363922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.363923 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:46.363996 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.363998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.364903 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.364904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.365508 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.365510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.366010 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.366011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.366087 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.366103 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.366386 (+ 283us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.366389 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.366448 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.366502 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260811 14:25:46.377615 22933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:46.377732 22933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:46.378515 22933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Sending DeleteTablet for 3 replicas of tablet 97017fd58e174fde80040ec1cdb0c4a3
I20260811 14:25:46.378857 23405 tablet_service.cc:1514] Processing DeleteTablet for tablet 97017fd58e174fde80040ec1cdb0c4a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:46 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49148
I20260811 14:25:46.379163 23092 tablet_service.cc:1514] Processing DeleteTablet for tablet 97017fd58e174fde80040ec1cdb0c4a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:46 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:47398
I20260811 14:25:46.379215 23247 tablet_service.cc:1514] Processing DeleteTablet for tablet 97017fd58e174fde80040ec1cdb0c4a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:46 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:51526
I20260811 14:25:46.379448 22933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:46.379599 22933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:46.379896 23569 tablet_replica.cc:330] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: stopping tablet replica
I20260811 14:25:46.380857 23405 tablet_service.cc:1467] Processing CreateTablet for tablet ca666afc7d0844f68aa0470824976bf3 (DEFAULT_TABLE table=test-table [id=80eb28056b6d4213b7a718507aeaf443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:46.380874 23092 tablet_service.cc:1467] Processing CreateTablet for tablet ca666afc7d0844f68aa0470824976bf3 (DEFAULT_TABLE table=test-table [id=80eb28056b6d4213b7a718507aeaf443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:46.380999 23092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca666afc7d0844f68aa0470824976bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:46.381000 23405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca666afc7d0844f68aa0470824976bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:46.382431 23509 tablet_bootstrap.cc:492] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Bootstrap starting.
I20260811 14:25:46.382444 23514 tablet_bootstrap.cc:492] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Bootstrap starting.
I20260811 14:25:46.382877 23514 tablet_bootstrap.cc:654] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:46.383420 23509 tablet_bootstrap.cc:654] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:46.383502 23247 tablet_service.cc:1467] Processing CreateTablet for tablet ca666afc7d0844f68aa0470824976bf3 (DEFAULT_TABLE table=test-table [id=80eb28056b6d4213b7a718507aeaf443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:46.383616 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca666afc7d0844f68aa0470824976bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:46.384548 23509 tablet_bootstrap.cc:492] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: No bootstrap required, opened a new log
I20260811 14:25:46.384596 23509 ts_tablet_manager.cc:1397] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:25:46.384756 23509 raft_consensus.cc:348] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.384837 23509 raft_consensus.cc:374] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:46.384859 23509 raft_consensus.cc:729] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a620dc925e468a94b5c6aa019504c0, State: Initialized, Role: FOLLOWER
I20260811 14:25:46.384902 23509 consensus_queue.cc:260] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.384982 23509 ts_tablet_manager.cc:1428] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:46.385011 23510 tablet_bootstrap.cc:492] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Bootstrap starting.
I20260811 14:25:46.385434 23510 tablet_bootstrap.cc:654] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:46.386206 23510 tablet_bootstrap.cc:492] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: No bootstrap required, opened a new log
I20260811 14:25:46.386262 23510 ts_tablet_manager.cc:1397] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:46.386389 23510 raft_consensus.cc:348] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.386459 23510 raft_consensus.cc:374] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:46.386480 23510 raft_consensus.cc:729] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789f6d345476427c87202223fc10597f, State: Initialized, Role: FOLLOWER
I20260811 14:25:46.386518 23510 consensus_queue.cc:260] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.386627 23510 ts_tablet_manager.cc:1428] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:46.386695 23538 raft_consensus.cc:482] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:46.386732 23538 raft_consensus.cc:504] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.386843 23538 leader_election.cc:288] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:46.387012 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca666afc7d0844f68aa0470824976bf3" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85" is_pre_election: true
I20260811 14:25:46.387127 23567 tablet_replica.cc:330] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: stopping tablet replica
I20260811 14:25:46.387209 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca666afc7d0844f68aa0470824976bf3" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0" is_pre_election: true
I20260811 14:25:46.387248 23567 raft_consensus.cc:2229] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:46.387274 23428 raft_consensus.cc:2454] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 0.
I20260811 14:25:46.387312 23567 raft_consensus.cc:2258] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:46.387414 23196 leader_election.cc:302] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789f6d345476427c87202223fc10597f, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:46.387499 23559 raft_consensus.cc:2781] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:46.387526 23559 raft_consensus.cc:482] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:46.387547 23559 raft_consensus.cc:3037] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.387724 23514 tablet_bootstrap.cc:492] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: No bootstrap required, opened a new log
I20260811 14:25:46.387768 23514 ts_tablet_manager.cc:1397] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 14:25:46.387907 23514 raft_consensus.cc:348] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.387969 23514 raft_consensus.cc:374] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:46.388010 23514 raft_consensus.cc:729] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Initialized, Role: FOLLOWER
I20260811 14:25:46.388064 23514 consensus_queue.cc:260] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.388167 23514 ts_tablet_manager.cc:1428] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:46.388252 23559 raft_consensus.cc:504] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.388370 23559 leader_election.cc:288] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 election: Requested vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:46.388615 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca666afc7d0844f68aa0470824976bf3" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0"
W20260811 14:25:46.388623 23193 leader_election.cc:341] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035): Illegal state: must be running to vote when last-logged opid is not known
I20260811 14:25:46.388671 23428 raft_consensus.cc:3037] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.388942 23567 ts_tablet_manager.cc:1905] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:46.389391 23428 raft_consensus.cc:2454] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 1.
I20260811 14:25:46.389545 23196 leader_election.cc:302] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789f6d345476427c87202223fc10597f, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:46.389631 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca666afc7d0844f68aa0470824976bf3" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85"
I20260811 14:25:46.389690 23114 raft_consensus.cc:3037] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:46.390414 23114 raft_consensus.cc:2454] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 1.
I20260811 14:25:46.390513 23567 ts_tablet_manager.cc:1918] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:46.390578 23567 log.cc:1196] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/97017fd58e174fde80040ec1cdb0c4a3
I20260811 14:25:46.390954 23559 raft_consensus.cc:2781] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:46.391010 23559 raft_consensus.cc:686] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 1 LEADER]: Becoming Leader. State: Replica: 789f6d345476427c87202223fc10597f, State: Running, Role: LEADER
I20260811 14:25:46.391047 23559 consensus_queue.cc:237] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:46.391224 23567 ts_tablet_manager.cc:1939] T 97017fd58e174fde80040ec1cdb0c4a3 P c0a620dc925e468a94b5c6aa019504c0: Deleting consensus metadata
I20260811 14:25:46.387032 23569 raft_consensus.cc:2229] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:46.391587 23569 raft_consensus.cc:2258] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:46.391621 22920 catalog_manager.cc:4841] TS c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527): tablet 97017fd58e174fde80040ec1cdb0c4a3 (table test-table [id=5ce5d42780d545d4a7943bc6433a8077]) successfully deleted
I20260811 14:25:46.391666 22933 catalog_manager.cc:5495] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f reported cstate change: term changed from 0 to 1, leader changed from <none> to 789f6d345476427c87202223fc10597f (127.20.132.194). New cstate: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } health_report { overall_health: UNKNOWN } } }
I20260811 14:25:46.392174 23570 tablet_replica.cc:330] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: stopping tablet replica
I20260811 14:25:46.392210 23569 ts_tablet_manager.cc:1905] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:46.392292 23570 raft_consensus.cc:2229] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:46.392364 23570 raft_consensus.cc:2258] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:46.392819 23570 ts_tablet_manager.cc:1905] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:46.393944 23569 ts_tablet_manager.cc:1918] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:46.394066 23569 log.cc:1196] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/97017fd58e174fde80040ec1cdb0c4a3
I20260811 14:25:46.394311 23570 ts_tablet_manager.cc:1918] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:46.394385 23570 log.cc:1196] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/97017fd58e174fde80040ec1cdb0c4a3
I20260811 14:25:46.394529 23569 ts_tablet_manager.cc:1939] T 97017fd58e174fde80040ec1cdb0c4a3 P 73c384149a9a4c7ab403bc368ef6dc85: Deleting consensus metadata
I20260811 14:25:46.394666 23570 ts_tablet_manager.cc:1939] T 97017fd58e174fde80040ec1cdb0c4a3 P 789f6d345476427c87202223fc10597f: Deleting consensus metadata
I20260811 14:25:46.395004 22916 catalog_manager.cc:4841] TS 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035): tablet 97017fd58e174fde80040ec1cdb0c4a3 (table test-table [id=5ce5d42780d545d4a7943bc6433a8077]) successfully deleted
I20260811 14:25:46.395129 22920 catalog_manager.cc:4841] TS 789f6d345476427c87202223fc10597f (127.20.132.194:40443): tablet 97017fd58e174fde80040ec1cdb0c4a3 (table test-table [id=5ce5d42780d545d4a7943bc6433a8077]) successfully deleted
I20260811 14:25:46.402237 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.399201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51538 (local address 127.20.132.194:40443)
0811 14:25:46.399328 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.399330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.399337 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:25:46.399358 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.399359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.399369 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.399421 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:46.399599 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.400389 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.401391 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.401694 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.401786 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.401967 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.402003 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.402068 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.402144 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.402166 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 14:25:46.407339 23507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.404313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:39625 (local address 127.20.132.194:40443)
0811 14:25:46.404473 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:46.404475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:46.404480 (+ 5us) server_negotiation.cc:407] Connection header received
0811 14:25:46.404496 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:46.404496 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:46.404504 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:46.404550 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:46.404713 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.405461 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.406512 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.406809 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.406878 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.407061 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.407093 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.407148 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:46.407231 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 14:25:46.407247 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146}
I20260811 14:25:46.407397 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:46.404302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:40443 (local address 127.20.132.194:39625)
0811 14:25:46.404354 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:46.404365 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:46.404413 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:46.404590 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:46.404591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:46.404593 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:25:46.404631 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.404632 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.405566 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.405567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.406416 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:46.406418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:46.406904 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:46.406905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:46.406962 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:46.406968 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:25:46.407171 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:25:46.407173 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:25:46.407228 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 14:25:46.407274 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:25:46.410058 23428 raft_consensus.cc:1261] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Refusing update from remote peer 789f6d345476427c87202223fc10597f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:46.410068 23114 raft_consensus.cc:1261] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Refusing update from remote peer 789f6d345476427c87202223fc10597f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:46.410234 23538 consensus_queue.cc:1035] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [LEADER]: Connected to new peer: Peer: permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:46.410454 23538 consensus_queue.cc:1035] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:25:46.416122 23545 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 14:25:47.938305 22933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:47.938421 22933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:47.939334 22933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Sending DeleteTablet for 3 replicas of tablet ca666afc7d0844f68aa0470824976bf3
I20260811 14:25:47.939615 23092 tablet_service.cc:1514] Processing DeleteTablet for tablet ca666afc7d0844f68aa0470824976bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:47 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:47398
I20260811 14:25:47.939635 23405 tablet_service.cc:1514] Processing DeleteTablet for tablet ca666afc7d0844f68aa0470824976bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:47 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49148
I20260811 14:25:47.939663 23247 tablet_service.cc:1514] Processing DeleteTablet for tablet ca666afc7d0844f68aa0470824976bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:47 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:51526
I20260811 14:25:47.940088 23607 tablet_replica.cc:330] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: stopping tablet replica
I20260811 14:25:47.940197 23607 raft_consensus.cc:2229] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:47.940263 23606 tablet_replica.cc:330] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: stopping tablet replica
I20260811 14:25:47.940290 23607 raft_consensus.cc:2258] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:47.940474 23605 tablet_replica.cc:330] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: stopping tablet replica
I20260811 14:25:47.940526 23605 raft_consensus.cc:2229] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:47.940518 23607 ts_tablet_manager.cc:1905] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:47.940559 23605 raft_consensus.cc:2258] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:47.940330 23606 raft_consensus.cc:2229] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:47.940639 23606 raft_consensus.cc:2258] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:47.940898 23605 ts_tablet_manager.cc:1905] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:47.942487 23607 ts_tablet_manager.cc:1918] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:25:47.942589 23607 log.cc:1196] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/ca666afc7d0844f68aa0470824976bf3
I20260811 14:25:47.942843 23605 ts_tablet_manager.cc:1918] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:25:47.942875 23607 ts_tablet_manager.cc:1939] T ca666afc7d0844f68aa0470824976bf3 P 789f6d345476427c87202223fc10597f: Deleting consensus metadata
I20260811 14:25:47.942914 23605 log.cc:1196] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/ca666afc7d0844f68aa0470824976bf3
I20260811 14:25:47.943142 23605 ts_tablet_manager.cc:1939] T ca666afc7d0844f68aa0470824976bf3 P 73c384149a9a4c7ab403bc368ef6dc85: Deleting consensus metadata
I20260811 14:25:47.943225 22920 catalog_manager.cc:4841] TS 789f6d345476427c87202223fc10597f (127.20.132.194:40443): tablet ca666afc7d0844f68aa0470824976bf3 (table test-table [id=80eb28056b6d4213b7a718507aeaf443]) successfully deleted
I20260811 14:25:47.943521 22916 catalog_manager.cc:4841] TS 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035): tablet ca666afc7d0844f68aa0470824976bf3 (table test-table [id=80eb28056b6d4213b7a718507aeaf443]) successfully deleted
I20260811 14:25:47.943573 23606 ts_tablet_manager.cc:1905] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:47.945202 23606 ts_tablet_manager.cc:1918] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:25:47.945276 23606 log.cc:1196] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/ca666afc7d0844f68aa0470824976bf3
I20260811 14:25:47.945569 23606 ts_tablet_manager.cc:1939] T ca666afc7d0844f68aa0470824976bf3 P c0a620dc925e468a94b5c6aa019504c0: Deleting consensus metadata
I20260811 14:25:47.945926 22920 catalog_manager.cc:4841] TS c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527): tablet ca666afc7d0844f68aa0470824976bf3 (table test-table [id=80eb28056b6d4213b7a718507aeaf443]) successfully deleted
Aug 11 14:25:47 dist-test-slave-cbbz krb5kdc[22885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458347, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:25:47 dist-test-slave-cbbz krb5kdc[22885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458347, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:47.973832 23615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:47.959887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43436 (local address 127.20.132.254:38063)
0811 14:25:47.960113 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:47.960115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:47.960128 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:25:47.960176 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:47.960176 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:47.960190 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:47.960288 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:47.960912 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:47.961451 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:47.962267 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:47.962477 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:47.962558 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:47.970606 (+ 8048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:47.970615 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:47.970615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:47.970626 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:47.972326 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:47.972781 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:47.972783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:47.972783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:47.972873 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:47.973153 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:47.973154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:47.973155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:47.973300 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:47.973440 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:47.973595 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 14:25:47.973695 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":126,"threads_started":1}
I20260811 14:25:47.975766 22933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:47.975930 22933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:47.977701 23092 tablet_service.cc:1467] Processing CreateTablet for tablet e2ce293882424aaa916337b7b1c8ce7b (DEFAULT_TABLE table=test-table [id=b5686d3cc16a47e0a4526fb0c3409cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:47.977731 23247 tablet_service.cc:1467] Processing CreateTablet for tablet e2ce293882424aaa916337b7b1c8ce7b (DEFAULT_TABLE table=test-table [id=b5686d3cc16a47e0a4526fb0c3409cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:47.977799 23405 tablet_service.cc:1467] Processing CreateTablet for tablet e2ce293882424aaa916337b7b1c8ce7b (DEFAULT_TABLE table=test-table [id=b5686d3cc16a47e0a4526fb0c3409cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:47.977855 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ce293882424aaa916337b7b1c8ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:47.977856 23092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ce293882424aaa916337b7b1c8ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:47.977946 23405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ce293882424aaa916337b7b1c8ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:47.979302 23617 tablet_bootstrap.cc:492] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Bootstrap starting.
I20260811 14:25:47.979337 23616 tablet_bootstrap.cc:492] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Bootstrap starting.
I20260811 14:25:47.979676 23617 tablet_bootstrap.cc:654] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:47.979743 23616 tablet_bootstrap.cc:654] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:47.980080 23619 tablet_bootstrap.cc:492] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Bootstrap starting.
I20260811 14:25:47.980489 23617 tablet_bootstrap.cc:492] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: No bootstrap required, opened a new log
I20260811 14:25:47.980538 23617 ts_tablet_manager.cc:1397] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:47.980551 23616 tablet_bootstrap.cc:492] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: No bootstrap required, opened a new log
I20260811 14:25:47.980599 23616 ts_tablet_manager.cc:1397] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:47.980682 23617 raft_consensus.cc:348] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:47.980762 23617 raft_consensus.cc:374] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:47.980777 23617 raft_consensus.cc:729] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789f6d345476427c87202223fc10597f, State: Initialized, Role: FOLLOWER
I20260811 14:25:47.980780 23616 raft_consensus.cc:348] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:47.980858 23616 raft_consensus.cc:374] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:47.980857 23617 consensus_queue.cc:260] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:47.980888 23616 raft_consensus.cc:729] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a620dc925e468a94b5c6aa019504c0, State: Initialized, Role: FOLLOWER
I20260811 14:25:47.980942 23616 consensus_queue.cc:260] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:47.980993 23617 ts_tablet_manager.cc:1428] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:47.981120 23616 ts_tablet_manager.cc:1428] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:47.981359 23619 tablet_bootstrap.cc:654] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:47.982060 23619 tablet_bootstrap.cc:492] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: No bootstrap required, opened a new log
I20260811 14:25:47.982132 23619 ts_tablet_manager.cc:1397] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:25:47.982298 23619 raft_consensus.cc:348] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:47.982359 23619 raft_consensus.cc:374] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:47.982374 23619 raft_consensus.cc:729] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Initialized, Role: FOLLOWER
I20260811 14:25:47.982446 23619 consensus_queue.cc:260] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:47.982622 23619 ts_tablet_manager.cc:1428] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:48.069008 23625 raft_consensus.cc:482] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:48.069120 23625 raft_consensus.cc:504] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.069351 23625 leader_election.cc:288] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789f6d345476427c87202223fc10597f (127.20.132.194:40443), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:48.069635 23269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ce293882424aaa916337b7b1c8ce7b" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789f6d345476427c87202223fc10597f" is_pre_election: true
I20260811 14:25:48.069657 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ce293882424aaa916337b7b1c8ce7b" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0" is_pre_election: true
I20260811 14:25:48.069763 23269 raft_consensus.cc:2454] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 0.
I20260811 14:25:48.069761 23428 raft_consensus.cc:2454] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 0.
I20260811 14:25:48.069938 23040 leader_election.cc:302] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73c384149a9a4c7ab403bc368ef6dc85, 789f6d345476427c87202223fc10597f; no voters:
I20260811 14:25:48.070055 23625 raft_consensus.cc:2781] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:48.070097 23625 raft_consensus.cc:482] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:48.070125 23625 raft_consensus.cc:3037] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:48.070935 23625 raft_consensus.cc:504] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.071084 23625 leader_election.cc:288] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 election: Requested vote from peers 789f6d345476427c87202223fc10597f (127.20.132.194:40443), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:48.071252 23269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ce293882424aaa916337b7b1c8ce7b" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789f6d345476427c87202223fc10597f"
I20260811 14:25:48.071264 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ce293882424aaa916337b7b1c8ce7b" candidate_uuid: "73c384149a9a4c7ab403bc368ef6dc85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0"
I20260811 14:25:48.071341 23269 raft_consensus.cc:3037] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:48.071380 23428 raft_consensus.cc:3037] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:48.072026 23428 raft_consensus.cc:2454] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 1.
I20260811 14:25:48.072034 23269 raft_consensus.cc:2454] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c384149a9a4c7ab403bc368ef6dc85 in term 1.
I20260811 14:25:48.072234 23040 leader_election.cc:302] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73c384149a9a4c7ab403bc368ef6dc85, 789f6d345476427c87202223fc10597f; no voters:
I20260811 14:25:48.072386 23625 raft_consensus.cc:2781] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:48.072549 23625 raft_consensus.cc:686] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 LEADER]: Becoming Leader. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Running, Role: LEADER
I20260811 14:25:48.072629 23625 consensus_queue.cc:237] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.073251 22933 catalog_manager.cc:5495] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "73c384149a9a4c7ab403bc368ef6dc85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } health_report { overall_health: UNKNOWN } } }
I20260811 14:25:48.102264 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:48.099132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47414 (local address 127.20.132.193:36035)
0811 14:25:48.099322 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:48.099323 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:48.099330 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:25:48.099349 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:48.099349 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:48.099359 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:48.099438 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:48.099617 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:48.100394 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:48.101360 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:48.101597 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:48.101706 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:48.101915 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:48.101963 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:48.102079 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:48.102174 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 14:25:48.102199 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":100,"threads_started":1}
I20260811 14:25:48.104941 23428 raft_consensus.cc:1261] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Refusing update from remote peer 73c384149a9a4c7ab403bc368ef6dc85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:48.104972 23269 raft_consensus.cc:1261] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Refusing update from remote peer 73c384149a9a4c7ab403bc368ef6dc85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:48.105211 23626 consensus_queue.cc:1035] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:48.105342 23625 consensus_queue.cc:1035] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:48.116777 22934 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:48.116875 22934 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:48.117554 22934 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Sending DeleteTablet for 3 replicas of tablet e2ce293882424aaa916337b7b1c8ce7b
I20260811 14:25:48.117792 23092 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ce293882424aaa916337b7b1c8ce7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:48 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:47398
I20260811 14:25:48.117807 23247 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ce293882424aaa916337b7b1c8ce7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:48 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:51526
I20260811 14:25:48.117852 23405 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ce293882424aaa916337b7b1c8ce7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:48 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49148
I20260811 14:25:48.117887 23607 tablet_replica.cc:330] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: stopping tablet replica
I20260811 14:25:48.117887 23605 tablet_replica.cc:330] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: stopping tablet replica
I20260811 14:25:48.117933 23607 raft_consensus.cc:2229] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:48.117941 23605 raft_consensus.cc:2229] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:48.117949 23606 tablet_replica.cc:330] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: stopping tablet replica
I20260811 14:25:48.117974 23607 raft_consensus.cc:2258] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:48.117996 23605 raft_consensus.cc:2258] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:48.118000 23606 raft_consensus.cc:2229] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:48.118042 23606 raft_consensus.cc:2258] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:48.118163 22934 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:48.118320 22934 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:48.118343 23605 ts_tablet_manager.cc:1905] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:48.118572 23606 ts_tablet_manager.cc:1905] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:48.118604 23607 ts_tablet_manager.cc:1905] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:48.120325 23606 ts_tablet_manager.cc:1918] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:48.120325 23607 ts_tablet_manager.cc:1918] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:48.120338 23605 ts_tablet_manager.cc:1918] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:25:48.120389 23606 log.cc:1196] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/e2ce293882424aaa916337b7b1c8ce7b
I20260811 14:25:48.120389 23607 log.cc:1196] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/e2ce293882424aaa916337b7b1c8ce7b
I20260811 14:25:48.120393 23605 log.cc:1196] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/e2ce293882424aaa916337b7b1c8ce7b
I20260811 14:25:48.120635 23606 ts_tablet_manager.cc:1939] T e2ce293882424aaa916337b7b1c8ce7b P c0a620dc925e468a94b5c6aa019504c0: Deleting consensus metadata
I20260811 14:25:48.120644 23607 ts_tablet_manager.cc:1939] T e2ce293882424aaa916337b7b1c8ce7b P 789f6d345476427c87202223fc10597f: Deleting consensus metadata
I20260811 14:25:48.120642 23605 ts_tablet_manager.cc:1939] T e2ce293882424aaa916337b7b1c8ce7b P 73c384149a9a4c7ab403bc368ef6dc85: Deleting consensus metadata
I20260811 14:25:48.120937 22920 catalog_manager.cc:4841] TS c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527): tablet e2ce293882424aaa916337b7b1c8ce7b (table test-table [id=b5686d3cc16a47e0a4526fb0c3409cbe]) successfully deleted
I20260811 14:25:48.120942 22916 catalog_manager.cc:4841] TS 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035): tablet e2ce293882424aaa916337b7b1c8ce7b (table test-table [id=b5686d3cc16a47e0a4526fb0c3409cbe]) successfully deleted
I20260811 14:25:48.121207 23092 tablet_service.cc:1467] Processing CreateTablet for tablet 64fcd55a136449acb39605daded36a90 (DEFAULT_TABLE table=test-table [id=0bb887a935aa4d56a90df4e2b109538a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:48.121321 23092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64fcd55a136449acb39605daded36a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:48.121371 23247 tablet_service.cc:1467] Processing CreateTablet for tablet 64fcd55a136449acb39605daded36a90 (DEFAULT_TABLE table=test-table [id=0bb887a935aa4d56a90df4e2b109538a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:48.121397 22920 catalog_manager.cc:4841] TS 789f6d345476427c87202223fc10597f (127.20.132.194:40443): tablet e2ce293882424aaa916337b7b1c8ce7b (table test-table [id=b5686d3cc16a47e0a4526fb0c3409cbe]) successfully deleted
I20260811 14:25:48.121467 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64fcd55a136449acb39605daded36a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:48.122241 23619 tablet_bootstrap.cc:492] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85: Bootstrap starting.
I20260811 14:25:48.122273 23617 tablet_bootstrap.cc:492] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Bootstrap starting.
I20260811 14:25:48.122328 23405 tablet_service.cc:1467] Processing CreateTablet for tablet 64fcd55a136449acb39605daded36a90 (DEFAULT_TABLE table=test-table [id=0bb887a935aa4d56a90df4e2b109538a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:48.122427 23405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64fcd55a136449acb39605daded36a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:48.122601 23619 tablet_bootstrap.cc:654] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:48.122670 23617 tablet_bootstrap.cc:654] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:48.123198 23619 tablet_bootstrap.cc:492] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85: No bootstrap required, opened a new log
I20260811 14:25:48.123281 23619 ts_tablet_manager.cc:1397] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:48.123394 23617 tablet_bootstrap.cc:492] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: No bootstrap required, opened a new log
I20260811 14:25:48.123432 23617 ts_tablet_manager.cc:1397] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:48.123394 23619 raft_consensus.cc:348] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.123462 23619 raft_consensus.cc:374] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:48.123488 23619 raft_consensus.cc:729] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c384149a9a4c7ab403bc368ef6dc85, State: Initialized, Role: FOLLOWER
I20260811 14:25:48.123535 23619 consensus_queue.cc:260] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.123564 23617 raft_consensus.cc:348] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.123623 23617 raft_consensus.cc:374] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:48.123642 23617 raft_consensus.cc:729] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789f6d345476427c87202223fc10597f, State: Initialized, Role: FOLLOWER
I20260811 14:25:48.123634 23616 tablet_bootstrap.cc:492] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Bootstrap starting.
I20260811 14:25:48.123647 23619 ts_tablet_manager.cc:1428] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:48.123692 23617 consensus_queue.cc:260] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.123817 23617 ts_tablet_manager.cc:1428] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:48.124089 23616 tablet_bootstrap.cc:654] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:48.124819 23616 tablet_bootstrap.cc:492] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: No bootstrap required, opened a new log
I20260811 14:25:48.124878 23616 ts_tablet_manager.cc:1397] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:48.125053 23616 raft_consensus.cc:348] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.125140 23616 raft_consensus.cc:374] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:48.125174 23616 raft_consensus.cc:729] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a620dc925e468a94b5c6aa019504c0, State: Initialized, Role: FOLLOWER
I20260811 14:25:48.125226 23616 consensus_queue.cc:260] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.125319 23616 ts_tablet_manager.cc:1428] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:48.434471 23517 raft_consensus.cc:482] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:48.434594 23517 raft_consensus.cc:504] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.434900 23517 leader_election.cc:288] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:48.435164 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64fcd55a136449acb39605daded36a90" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85" is_pre_election: true
I20260811 14:25:48.435164 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64fcd55a136449acb39605daded36a90" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0" is_pre_election: true
I20260811 14:25:48.435292 23428 raft_consensus.cc:2454] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 0.
I20260811 14:25:48.435292 23114 raft_consensus.cc:2454] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 0.
I20260811 14:25:48.435498 23193 leader_election.cc:302] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 73c384149a9a4c7ab403bc368ef6dc85, 789f6d345476427c87202223fc10597f, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:48.435626 23517 raft_consensus.cc:2781] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:48.435680 23517 raft_consensus.cc:482] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:48.435707 23517 raft_consensus.cc:3037] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:48.436484 23517 raft_consensus.cc:504] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.436664 23517 leader_election.cc:288] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 election: Requested vote from peers 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035), c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527)
I20260811 14:25:48.436863 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64fcd55a136449acb39605daded36a90" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c384149a9a4c7ab403bc368ef6dc85"
I20260811 14:25:48.436853 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64fcd55a136449acb39605daded36a90" candidate_uuid: "789f6d345476427c87202223fc10597f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a620dc925e468a94b5c6aa019504c0"
I20260811 14:25:48.436929 23428 raft_consensus.cc:3037] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:48.436959 23114 raft_consensus.cc:3037] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:48.437570 23428 raft_consensus.cc:2454] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 1.
I20260811 14:25:48.437597 23114 raft_consensus.cc:2454] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789f6d345476427c87202223fc10597f in term 1.
I20260811 14:25:48.437758 23196 leader_election.cc:302] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789f6d345476427c87202223fc10597f, c0a620dc925e468a94b5c6aa019504c0; no voters:
I20260811 14:25:48.437867 23517 raft_consensus.cc:2781] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:48.437932 23517 raft_consensus.cc:686] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 1 LEADER]: Becoming Leader. State: Replica: 789f6d345476427c87202223fc10597f, State: Running, Role: LEADER
I20260811 14:25:48.437992 23517 consensus_queue.cc:237] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } }
I20260811 14:25:48.438673 22934 catalog_manager.cc:5495] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f reported cstate change: term changed from 0 to 1, leader changed from <none> to 789f6d345476427c87202223fc10597f (127.20.132.194). New cstate: current_term: 1 leader_uuid: "789f6d345476427c87202223fc10597f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789f6d345476427c87202223fc10597f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 } health_report { overall_health: UNKNOWN } } }
I20260811 14:25:48.482704 23641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:48.480251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34800 (local address 127.20.132.194:40443)
0811 14:25:48.480365 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:48.480366 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:48.480372 (+ 6us) server_negotiation.cc:407] Connection header received
0811 14:25:48.480390 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:48.480390 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:48.480398 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:48.480480 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:48.480590 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:48.481065 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:48.481926 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:48.482152 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:48.482248 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:48.482414 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:48.482458 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:48.482527 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:48.482589 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 14:25:48.482612 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
I20260811 14:25:48.484891 23114 raft_consensus.cc:1261] T 64fcd55a136449acb39605daded36a90 P 73c384149a9a4c7ab403bc368ef6dc85 [term 1 FOLLOWER]: Refusing update from remote peer 789f6d345476427c87202223fc10597f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:48.484894 23428 raft_consensus.cc:1261] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Refusing update from remote peer 789f6d345476427c87202223fc10597f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:48.485157 23589 consensus_queue.cc:1035] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [LEADER]: Connected to new peer: Peer: permanent_uuid: "73c384149a9a4c7ab403bc368ef6dc85" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:48.485291 23581 consensus_queue.cc:1035] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a620dc925e468a94b5c6aa019504c0" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:25:48.489594 23579 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 14:25:50.008123 22933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:50.008261 22933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:50.009123 22933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77f6550defbf453493d2dfc20efc4784: Sending DeleteTablet for 3 replicas of tablet 64fcd55a136449acb39605daded36a90
I20260811 14:25:50.009382 23245 tablet_service.cc:1514] Processing DeleteTablet for tablet 64fcd55a136449acb39605daded36a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:50 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:51526
I20260811 14:25:50.009402 23092 tablet_service.cc:1514] Processing DeleteTablet for tablet 64fcd55a136449acb39605daded36a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:50 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:47398
I20260811 14:25:50.009516 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 23019
I20260811 14:25:50.009582 23405 tablet_service.cc:1514] Processing DeleteTablet for tablet 64fcd55a136449acb39605daded36a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:50 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49148
I20260811 14:25:50.012650 23668 tablet_replica.cc:330] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: stopping tablet replica
I20260811 14:25:50.012754 23668 raft_consensus.cc:2229] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:50.012827 23668 raft_consensus.cc:2258] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:50.013115 23668 ts_tablet_manager.cc:1905] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:50.015152 23668 ts_tablet_manager.cc:1918] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:25:50.015225 23668 log.cc:1196] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/64fcd55a136449acb39605daded36a90
I20260811 14:25:50.015444 23668 ts_tablet_manager.cc:1939] T 64fcd55a136449acb39605daded36a90 P c0a620dc925e468a94b5c6aa019504c0: Deleting consensus metadata
I20260811 14:25:50.016319 23666 tablet_replica.cc:330] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: stopping tablet replica
I20260811 14:25:50.016410 23666 raft_consensus.cc:2229] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:50.016485 23666 raft_consensus.cc:2258] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:50.016552 22920 catalog_manager.cc:4841] TS c0a620dc925e468a94b5c6aa019504c0 (127.20.132.195:41527): tablet 64fcd55a136449acb39605daded36a90 (table test-table [id=0bb887a935aa4d56a90df4e2b109538a]) successfully deleted
I20260811 14:25:50.016881 23666 ts_tablet_manager.cc:1905] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:50.018867 23666 ts_tablet_manager.cc:1918] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:25:50.018931 23666 log.cc:1196] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/64fcd55a136449acb39605daded36a90
I20260811 14:25:50.019199 23666 ts_tablet_manager.cc:1939] T 64fcd55a136449acb39605daded36a90 P 789f6d345476427c87202223fc10597f: Deleting consensus metadata
W20260811 14:25:50.019421 22916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:36035 (error 108)
I20260811 14:25:50.019719 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 23176
I20260811 14:25:50.022718 23671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:50.019841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36035 (local address 127.0.0.1:50758)
0811 14:25:50.022587 (+ 2746us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:50.022661 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2713,"thread_start_us":70,"threads_started":1}
W20260811 14:25:50.022836 22916 catalog_manager.cc:4584] TS 73c384149a9a4c7ab403bc368ef6dc85 (127.20.132.193:36035): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 64fcd55a136449acb39605daded36a90: Network error: Client connection negotiation failed: client connection to 127.20.132.193:36035: connect: Connection refused (error 111)
I20260811 14:25:50.027359 22920 catalog_manager.cc:4841] TS 789f6d345476427c87202223fc10597f (127.20.132.194:40443): tablet 64fcd55a136449acb39605daded36a90 (table test-table [id=0bb887a935aa4d56a90df4e2b109538a]) successfully deleted
I20260811 14:25:50.031214 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 23330
I20260811 14:25:50.036898 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 22900
2026-08-11T14:25:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7314 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:50 dist-test-slave-cbbz krb5kdc[23674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:50 dist-test-slave-cbbz krb5kdc[23674](info): set up 2 sockets
Aug 11 14:25:50 dist-test-slave-cbbz krb5kdc[23674](info): commencing operation
krb5kdc: starting...
W20260811 14:25:51.161154 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:51.283797 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41723
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:41723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:51.364735 23689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:51.364979 23689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:51.365020 23689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:51.366210 23689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:51.366285 23689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:51.366312 23689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:51.366341 23689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:51.366371 23689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:51.367884 23689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:41723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:51.368235 23689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:51.368487 23689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:51.374112 23696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:51.374132 23689 server_base.cc:1034] running on GCE node
W20260811 14:25:51.374100 23698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.374100 23695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:51.374571 23689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:51.374893 23689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:51.376041 23689 hybrid_clock.cc:648] HybridClock initialized: now 1786458351376017 us; error 38 us; skew 500 ppm
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:51.378525 23689 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:51.378953 23689 webserver.cc:460] Webserver started at http://127.20.132.254:37105/ using document root <none> and password file <none>
I20260811 14:25:51.379192 23689 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:51.379271 23689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:51.379421 23689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:51.380524 23689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "558d496ccbb84e039480cd1e8914235b"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "cb9d88807bd6276c8a5df41a49fd37c3"
server_key_iv: "754cd8406907660f5a0c9403bef48acd"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.380896 23689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "558d496ccbb84e039480cd1e8914235b"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "cb9d88807bd6276c8a5df41a49fd37c3"
server_key_iv: "754cd8406907660f5a0c9403bef48acd"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.382256 23689 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:25:51.382962 23705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.383136 23689 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:51.383248 23689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "558d496ccbb84e039480cd1e8914235b"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "cb9d88807bd6276c8a5df41a49fd37c3"
server_key_iv: "754cd8406907660f5a0c9403bef48acd"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.383325 23689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:51.420495 23689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:51.422652 23689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:51.422864 23689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:51.427258 23689 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:41723
I20260811 14:25:51.427309 23760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:41723 every 8 connection(s)
I20260811 14:25:51.427959 23689 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:51.428783 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 23689
I20260811 14:25:51.428893 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:51.429077 21011 external_mini_cluster.cc:1428] Setting key e1b7a2aa51fc0d46a077de3063d71de9
I20260811 14:25:51.429072 23761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:51.432632 23761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b: Bootstrap starting.
I20260811 14:25:51.433260 23761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:51.433565 23761 log.cc:824] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:51.434356 23761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b: No bootstrap required, opened a new log
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:51.436597 23761 raft_consensus.cc:348] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558d496ccbb84e039480cd1e8914235b" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41723 } }
I20260811 14:25:51.436795 23761 raft_consensus.cc:374] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:51.436851 23761 raft_consensus.cc:729] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558d496ccbb84e039480cd1e8914235b, State: Initialized, Role: FOLLOWER
I20260811 14:25:51.436983 23761 consensus_queue.cc:260] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558d496ccbb84e039480cd1e8914235b" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41723 } }
I20260811 14:25:51.437063 23761 raft_consensus.cc:388] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:51.437086 23761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:51.437160 23761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:51.437911 23761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558d496ccbb84e039480cd1e8914235b" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41723 } }
I20260811 14:25:51.438054 23761 leader_election.cc:302] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 558d496ccbb84e039480cd1e8914235b; no voters:
I20260811 14:25:51.438221 23761 leader_election.cc:288] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:51.438264 23766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:51.438392 23766 raft_consensus.cc:686] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [term 1 LEADER]: Becoming Leader. State: Replica: 558d496ccbb84e039480cd1e8914235b, State: Running, Role: LEADER
I20260811 14:25:51.438503 23761 sys_catalog.cc:564] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:51.438539 23766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558d496ccbb84e039480cd1e8914235b" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41723 } }
I20260811 14:25:51.438899 23767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "558d496ccbb84e039480cd1e8914235b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558d496ccbb84e039480cd1e8914235b" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41723 } } }
I20260811 14:25:51.439075 23767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:51.438889 23766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 558d496ccbb84e039480cd1e8914235b. Latest consensus state: current_term: 1 leader_uuid: "558d496ccbb84e039480cd1e8914235b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558d496ccbb84e039480cd1e8914235b" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41723 } } }
I20260811 14:25:51.439617 23766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:51.439785 23776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:51.440454 23776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:51.441001 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.429653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45466 (local address 127.20.132.254:41723)
0811 14:25:51.429865 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:51.429876 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:51.429913 (+ 37us) server_negotiation.cc:407] Connection header received
0811 14:25:51.430416 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:51.430425 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:51.430495 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:51.430648 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:51.431284 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.432676 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.433518 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.433978 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.434105 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.436862 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:51.436867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:51.436867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:51.436880 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:51.438963 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.439420 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.439423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.439424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.439534 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.439775 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.439776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.439776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.440269 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:51.440419 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:51.440658 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 14:25:51.440800 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":105,"threads_started":1}
I20260811 14:25:51.442080 23776 catalog_manager.cc:1347] Generated new cluster ID: 07c49213a5874f1a9221b251228cda61
I20260811 14:25:51.442132 23776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:25:51.449690 23776 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:51.450191 23776 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:51.452343 23776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 558d496ccbb84e039480cd1e8914235b: Generated new TSK 0
I20260811 14:25:51.452526 23776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:51.486759 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41723
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:51.568974 23790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:51.569180 23790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:51.569204 23790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:51.570492 23790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:51.570538 23790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:51.570564 23790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:51.572042 23790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:51.572330 23790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:51.572557 23790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:51.577533 23796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.577608 23798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.577533 23795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:51.577802 23790 server_base.cc:1034] running on GCE node
I20260811 14:25:51.577992 23790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:51.578197 23790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:51.579349 23790 hybrid_clock.cc:648] HybridClock initialized: now 1786458351579321 us; error 45 us; skew 500 ppm
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:51.581946 23790 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:51.582396 23790 webserver.cc:460] Webserver started at http://127.20.132.193:35491/ using document root <none> and password file <none>
I20260811 14:25:51.582633 23790 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:51.582679 23790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:51.582835 23790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:51.583900 23790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "138d7dbd83d14d4aa1bbae99e8a93bef"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "3537034301fbbbc81d6eff7ee80c6761"
server_key_iv: "39f2c3095bd4f7b350158a423d3ab1e8"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.584293 23790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "138d7dbd83d14d4aa1bbae99e8a93bef"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "3537034301fbbbc81d6eff7ee80c6761"
server_key_iv: "39f2c3095bd4f7b350158a423d3ab1e8"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.585621 23790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:51.586398 23807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.586586 23790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:51.586658 23790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "138d7dbd83d14d4aa1bbae99e8a93bef"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "3537034301fbbbc81d6eff7ee80c6761"
server_key_iv: "39f2c3095bd4f7b350158a423d3ab1e8"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.586759 23790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:51.613819 23790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:51.615759 23790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:51.615875 23790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:51.616189 23790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:51.616541 23790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:51.616600 23790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.616644 23790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:51.616677 23790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.623237 23790 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:37243
I20260811 14:25:51.623281 23931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:37243 every 8 connection(s)
I20260811 14:25:51.623620 23790 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:51.632085 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 23790
I20260811 14:25:51.632210 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:51.632434 21011 external_mini_cluster.cc:1428] Setting key 1f1d29692bd191e23744d554c2264d4b
I20260811 14:25:51.633996 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.624428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:37883 (local address 127.20.132.254:41723)
0811 14:25:51.624476 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:51.624478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:51.624650 (+ 172us) server_negotiation.cc:407] Connection header received
0811 14:25:51.625150 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:51.625151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:51.625160 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:51.625214 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:51.626131 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.626623 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.627744 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.627945 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.628004 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.630437 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:51.630439 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:51.630439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:51.630463 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:51.632403 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.632961 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.632962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.632963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.633030 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.633300 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.633301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.633302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.633427 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:51.633514 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:51.633811 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 14:25:51.633903 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:25:51.634219 23935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.624351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:41723 (local address 127.20.132.193:37883)
0811 14:25:51.624529 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:51.624572 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:51.625058 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:51.625274 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:51.625277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:51.625849 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:51.626048 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:51.626052 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.626707 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.626708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:51.627638 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:51.627642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.628030 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.628031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:51.628197 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.628722 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:51.628730 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:51.630211 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:51.632507 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:51.632514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:51.632516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:51.632873 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:51.633109 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:51.633109 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:51.633110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:51.633216 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:51.633505 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:51.633513 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:51.633666 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 14:25:51.633789 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 14:25:51.633952 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
I20260811 14:25:51.638499 23932 heartbeater.cc:347] Connected to a master server at 127.20.132.254:41723
I20260811 14:25:51.638640 23932 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:51.638880 23932 heartbeater.cc:511] Master 127.20.132.254:41723 requested a full tablet report, sending...
I20260811 14:25:51.639532 23724 ts_manager.cc:194] Registered new tserver with Master: 138d7dbd83d14d4aa1bbae99e8a93bef (127.20.132.193:37243)
I20260811 14:25:51.640300 23724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:37883
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:51.663241 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41723
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:51.747848 23939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:51.748102 23939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:51.748160 23939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:51.749317 23939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:51.749392 23939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:51.749437 23939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:51.750927 23939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:51.751222 23939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:51.751466 23939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:51.756623 23951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.756681 23948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.756683 23946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:51.756878 23939 server_base.cc:1034] running on GCE node
I20260811 14:25:51.757169 23939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:51.757426 23939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:51.758613 23939 hybrid_clock.cc:648] HybridClock initialized: now 1786458351758611 us; error 42 us; skew 500 ppm
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:51.761210 23939 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:51.761807 23939 webserver.cc:460] Webserver started at http://127.20.132.194:40867/ using document root <none> and password file <none>
I20260811 14:25:51.762063 23939 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:51.762135 23939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:51.762327 23939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:51.763445 23939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "c55bc3f15fad40ff91251a4bc8c21162"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "0ab9a74a87b679aa7bd250c51f68cc4a"
server_key_iv: "09962255d516d6b7ccf4d7c726b032de"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.763836 23939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "c55bc3f15fad40ff91251a4bc8c21162"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "0ab9a74a87b679aa7bd250c51f68cc4a"
server_key_iv: "09962255d516d6b7ccf4d7c726b032de"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.765252 23939 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:51.766031 23959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.766207 23939 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:51.766317 23939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "c55bc3f15fad40ff91251a4bc8c21162"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "0ab9a74a87b679aa7bd250c51f68cc4a"
server_key_iv: "09962255d516d6b7ccf4d7c726b032de"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.766403 23939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:51.776710 23939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:51.778748 23939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:51.778926 23939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:51.779178 23939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:51.779510 23939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:51.779572 23939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.779606 23939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:51.779637 23939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.786362 23939 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:40707
I20260811 14:25:51.786432 24085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:40707 every 8 connection(s)
I20260811 14:25:51.786756 23939 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:51.788308 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 23939
I20260811 14:25:51.788414 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:51.788623 21011 external_mini_cluster.cc:1428] Setting key 20938d60ad9c538051f87aef3542e660
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:51.798009 24089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.787474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:41723 (local address 127.20.132.194:33719)
0811 14:25:51.787652 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:51.787694 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:51.788318 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:51.788705 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:51.788709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:51.789692 (+ 983us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:51.789981 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:51.789988 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.790789 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.790790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:51.791787 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:51.791790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.792362 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.792363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:51.792471 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.793001 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:51.793008 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:51.794695 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:51.796628 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:51.796635 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:51.796636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:51.796854 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:51.797109 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:51.797109 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:51.797110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:51.797229 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:51.797537 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:51.797541 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:51.797650 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 14:25:51.797732 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 14:25:51.797849 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":107,"threads_started":1}
I20260811 14:25:51.798010 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.787508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:33719 (local address 127.20.132.254:41723)
0811 14:25:51.787574 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:51.787576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:51.787793 (+ 217us) server_negotiation.cc:407] Connection header received
0811 14:25:51.788461 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:51.788462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:51.788478 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:51.788514 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:51.790106 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.790698 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.791881 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.792272 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.792349 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.794802 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:51.794804 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:51.794805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:51.794814 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:51.796533 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.796950 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.796951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.796952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.797032 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.797304 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.797305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.797306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.797450 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:51.797545 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:51.797785 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 14:25:51.797875 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
I20260811 14:25:51.798599 24086 heartbeater.cc:347] Connected to a master server at 127.20.132.254:41723
I20260811 14:25:51.798724 24086 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:51.798919 24086 heartbeater.cc:511] Master 127.20.132.254:41723 requested a full tablet report, sending...
I20260811 14:25:51.799297 23724 ts_manager.cc:194] Registered new tserver with Master: c55bc3f15fad40ff91251a4bc8c21162 (127.20.132.194:40707)
I20260811 14:25:51.799628 23724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:33719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:51.819193 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41723
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:51.902235 24092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:51.902458 24092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:51.902498 24092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:51.903633 24092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:51.903709 24092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:51.903755 24092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:51.905246 24092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:51.905515 24092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:51.906209 24092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:51.911664 24099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.911659 24101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:51.911701 24098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:51.911911 24092 server_base.cc:1034] running on GCE node
I20260811 14:25:51.912273 24092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:51.912544 24092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:51.913753 24092 hybrid_clock.cc:648] HybridClock initialized: now 1786458351913736 us; error 26 us; skew 500 ppm
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:51.916339 24092 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:51.916801 24092 webserver.cc:460] Webserver started at http://127.20.132.195:36197/ using document root <none> and password file <none>
I20260811 14:25:51.917040 24092 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:51.917084 24092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:51.917246 24092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:51.918339 24092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "39acb498ada6476ab10bf1b047044b77"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "a71da9d109afbb941f5c614c4e9f8f5d"
server_key_iv: "c72b74ec5f74437118f91bc32c4abe6d"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.918707 24092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "39acb498ada6476ab10bf1b047044b77"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "a71da9d109afbb941f5c614c4e9f8f5d"
server_key_iv: "c72b74ec5f74437118f91bc32c4abe6d"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.920033 24092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:25:51.920827 24108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.921061 24092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:51.921154 24092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "39acb498ada6476ab10bf1b047044b77"
format_stamp: "Formatted at 2026-08-11 14:25:51 on dist-test-slave-cbbz"
server_key: "a71da9d109afbb941f5c614c4e9f8f5d"
server_key_iv: "c72b74ec5f74437118f91bc32c4abe6d"
server_key_version: "encryptionkey@0"
I20260811 14:25:51.921238 24092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:51.934156 24092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:51.935937 24092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:51.936129 24092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:51.936434 24092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:51.936774 24092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:51.936834 24092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.936877 24092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:51.936905 24092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:51.943614 24092 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:39649
I20260811 14:25:51.943670 24235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:39649 every 8 connection(s)
I20260811 14:25:51.943964 24092 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:25:51 dist-test-slave-cbbz krb5kdc[23674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458351, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:51.953276 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.944647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:50721 (local address 127.20.132.254:41723)
0811 14:25:51.944713 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:51.944715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:51.944895 (+ 180us) server_negotiation.cc:407] Connection header received
0811 14:25:51.945435 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:51.945437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:51.945449 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:51.945515 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:51.946452 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.946997 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.948007 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.948280 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.948370 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.950468 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:51.950469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:51.950469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:51.950476 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:51.951639 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.952079 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.952081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.952081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.952216 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:51.952582 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:51.952583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:51.952584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:51.952744 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:51.952810 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:51.953146 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 14:25:51.953213 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:25:51.953392 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:51.944610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:41723 (local address 127.20.132.195:50721)
0811 14:25:51.944770 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:51.944815 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:51.945328 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:51.945584 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:51.945588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:51.946158 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:51.946351 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:51.946355 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.947104 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.947105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:51.947899 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:51.947901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:51.948382 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:51.948383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:51.948511 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:51.948949 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:51.948956 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:51.950346 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:51.951742 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:51.951749 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:51.951751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:51.951977 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:51.952330 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:51.952331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:51.952331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:51.952504 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:51.952825 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:51.952831 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:51.952984 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 14:25:51.953071 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 14:25:51.953193 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260811 14:25:51.953986 24236 heartbeater.cc:347] Connected to a master server at 127.20.132.254:41723
I20260811 14:25:51.954101 24236 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:51.954227 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24092
I20260811 14:25:51.954320 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:51.954341 24236 heartbeater.cc:511] Master 127.20.132.254:41723 requested a full tablet report, sending...
I20260811 14:25:51.954553 21011 external_mini_cluster.cc:1428] Setting key 8d3783fb238591be35764b6664b5a577
I20260811 14:25:51.954823 23724 ts_manager.cc:194] Registered new tserver with Master: 39acb498ada6476ab10bf1b047044b77 (127.20.132.195:39649)
I20260811 14:25:51.955282 23724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:50721
I20260811 14:25:51.955488 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 14:25:51.967509 23764 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:25:51.966527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45476 (local address 127.20.132.254:41723)
0811 14:25:51.966618 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:51.966620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:51.966715 (+ 95us) server_negotiation.cc:407] Connection header received
0811 14:25:51.966819 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:51.966820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:51.966831 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:51.966913 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:51.967437 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45476: BlockingRecv error: recv got EOF from 127.0.0.1:45476 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:25:51.968981 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 23790
I20260811 14:25:51.977707 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 23939
I20260811 14:25:51.983973 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24092
I20260811 14:25:51.988802 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 23689
2026-08-11T14:25:51Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1948 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:52 dist-test-slave-cbbz krb5kdc[24252](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:52 dist-test-slave-cbbz krb5kdc[24252](info): set up 2 sockets
Aug 11 14:25:52 dist-test-slave-cbbz krb5kdc[24252](info): commencing operation
krb5kdc: starting...
W20260811 14:25:53.095235 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:53 dist-test-slave-cbbz krb5kdc[24252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:53.219537 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46173
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:53.299953 24267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:53.300220 24267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:53.300271 24267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:53.301419 24267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:53.301483 24267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:53.301512 24267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:53.301542 24267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:53.301566 24267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:53.303057 24267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:53.303331 24267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:53.303550 24267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:53.308317 24276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:53.308300 24273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:53.308292 24274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:53.308478 24267 server_base.cc:1034] running on GCE node
I20260811 14:25:53.308846 24267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:53.309149 24267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:53.310316 24267 hybrid_clock.cc:648] HybridClock initialized: now 1786458353310299 us; error 33 us; skew 500 ppm
Aug 11 14:25:53 dist-test-slave-cbbz krb5kdc[24252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458353, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:53.320091 24267 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:53.320590 24267 webserver.cc:460] Webserver started at http://127.20.132.254:45385/ using document root <none> and password file <none>
I20260811 14:25:53.320825 24267 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:53.320895 24267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:53.321054 24267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:53.322144 24267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "8202d7105583440eb1e93bc2acacb85d"
format_stamp: "Formatted at 2026-08-11 14:25:53 on dist-test-slave-cbbz"
server_key: "0beabe8d68ec629b0c6007ea93b81191"
server_key_iv: "83d6038b8b5cd92cbf1610f569566731"
server_key_version: "encryptionkey@0"
I20260811 14:25:53.322512 24267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "8202d7105583440eb1e93bc2acacb85d"
format_stamp: "Formatted at 2026-08-11 14:25:53 on dist-test-slave-cbbz"
server_key: "0beabe8d68ec629b0c6007ea93b81191"
server_key_iv: "83d6038b8b5cd92cbf1610f569566731"
server_key_version: "encryptionkey@0"
I20260811 14:25:53.323844 24267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 14:25:53.324664 24285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:53.324842 24267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:53.324944 24267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8202d7105583440eb1e93bc2acacb85d"
format_stamp: "Formatted at 2026-08-11 14:25:53 on dist-test-slave-cbbz"
server_key: "0beabe8d68ec629b0c6007ea93b81191"
server_key_iv: "83d6038b8b5cd92cbf1610f569566731"
server_key_version: "encryptionkey@0"
I20260811 14:25:53.325021 24267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:53.332845 24267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:53.334733 24267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:53.334903 24267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:53.339040 24267 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:46173
I20260811 14:25:53.339071 24346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:46173 every 8 connection(s)
I20260811 14:25:53.339614 24267 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:53.340379 24347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:53.342670 24347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d: Bootstrap starting.
I20260811 14:25:53.343235 24347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:53.343474 24347 log.cc:824] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:53.344130 24347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d: No bootstrap required, opened a new log
I20260811 14:25:53.344379 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24267
I20260811 14:25:53.344475 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:53.344661 21011 external_mini_cluster.cc:1428] Setting key 21c094a742c648b1264a2dc0b9923bbb
I20260811 14:25:53.346814 24347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202d7105583440eb1e93bc2acacb85d" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46173 } }
I20260811 14:25:53.346992 24347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:53.347033 24347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8202d7105583440eb1e93bc2acacb85d, State: Initialized, Role: FOLLOWER
I20260811 14:25:53.347204 24347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202d7105583440eb1e93bc2acacb85d" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46173 } }
I20260811 14:25:53.347301 24347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:53.347340 24347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:53.347391 24347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:53.348084 24347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202d7105583440eb1e93bc2acacb85d" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46173 } }
I20260811 14:25:53.348225 24347 leader_election.cc:302] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8202d7105583440eb1e93bc2acacb85d; no voters:
I20260811 14:25:53.348389 24347 leader_election.cc:288] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:53.348419 24352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:53.348526 24352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [term 1 LEADER]: Becoming Leader. State: Replica: 8202d7105583440eb1e93bc2acacb85d, State: Running, Role: LEADER
I20260811 14:25:53.348663 24347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:53.348663 24352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202d7105583440eb1e93bc2acacb85d" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46173 } }
I20260811 14:25:53.349121 24353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8202d7105583440eb1e93bc2acacb85d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202d7105583440eb1e93bc2acacb85d" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46173 } } }
I20260811 14:25:53.349156 24354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8202d7105583440eb1e93bc2acacb85d. Latest consensus state: current_term: 1 leader_uuid: "8202d7105583440eb1e93bc2acacb85d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8202d7105583440eb1e93bc2acacb85d" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46173 } } }
I20260811 14:25:53.349231 24353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:53.349255 24354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:53.349515 24360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:53.350139 24360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:53.352027 24360 catalog_manager.cc:1347] Generated new cluster ID: 95833e1d9c804f398285d9cdb6d4ccce
I20260811 14:25:53.352097 24360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:25:53 dist-test-slave-cbbz krb5kdc[24252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:53.356969 24351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:53.345199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58744 (local address 127.20.132.254:46173)
0811 14:25:53.345440 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:53.345449 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:53.345499 (+ 50us) server_negotiation.cc:407] Connection header received
0811 14:25:53.346798 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:53.346804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:53.346851 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:53.346966 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:53.347841 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:53.349102 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:53.350225 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:53.350749 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:53.350873 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:53.353554 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:53.353558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:53.353559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:53.353571 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:53.355284 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:53.355670 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:53.355673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:53.355674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:53.355777 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:53.355994 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:53.355995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:53.355996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:53.356323 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:53.356498 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:53.356571 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 14:25:53.356824 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260811 14:25:53.357828 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:25:53.362807 24360 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:53.363472 24360 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:53.375520 24360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8202d7105583440eb1e93bc2acacb85d: Generated new TSK 0
I20260811 14:25:53.375780 24360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:25:53.377291 24351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:53.373170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58746 (local address 127.20.132.254:46173)
0811 14:25:53.373213 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:53.373215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:53.373326 (+ 111us) server_negotiation.cc:407] Connection header received
0811 14:25:53.373394 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:53.373395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:53.373406 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:53.373481 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:53.373883 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:53.374664 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:53.375658 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:53.376015 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:53.376078 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:53.376821 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:53.376823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:53.376823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:53.377039 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:53.377057 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:53.377064 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:53.377147 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:53.377187 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 14:25:53.377215 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:25:53.379737 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24267
2026-08-11T14:25:53Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1391 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:53 dist-test-slave-cbbz krb5kdc[24383](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:53 dist-test-slave-cbbz krb5kdc[24383](info): set up 2 sockets
Aug 11 14:25:53 dist-test-slave-cbbz krb5kdc[24383](info): commencing operation
krb5kdc: starting...
W20260811 14:25:54.471391 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:54 dist-test-slave-cbbz krb5kdc[24383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:54.591624 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37731
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:54.674572 24398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:54.674775 24398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:54.674798 24398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:54.675909 24398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:54.675943 24398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:54.675957 24398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:54.675971 24398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:54.675982 24398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:54.677475 24398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:54.677675 24398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:54.677843 24398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:54.682632 24407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:54.682662 24405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:54.682788 24398 server_base.cc:1034] running on GCE node
W20260811 14:25:54.682644 24404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:54.683229 24398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:54.683547 24398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:54.684695 24398 hybrid_clock.cc:648] HybridClock initialized: now 1786458354684687 us; error 34 us; skew 500 ppm
Aug 11 14:25:54 dist-test-slave-cbbz krb5kdc[24383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458354, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:54.687204 24398 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:54.687644 24398 webserver.cc:460] Webserver started at http://127.20.132.254:38205/ using document root <none> and password file <none>
I20260811 14:25:54.687891 24398 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:54.687961 24398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:54.688112 24398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:54.689175 24398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "4ff0579b7a84460886832b5c15fefc7e"
format_stamp: "Formatted at 2026-08-11 14:25:54 on dist-test-slave-cbbz"
server_key: "64158c738e5cea1ae3f76c65ac6a375c"
server_key_iv: "d9f76c177f6838e07424f789e0bf79c1"
server_key_version: "encryptionkey@0"
I20260811 14:25:54.689553 24398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "4ff0579b7a84460886832b5c15fefc7e"
format_stamp: "Formatted at 2026-08-11 14:25:54 on dist-test-slave-cbbz"
server_key: "64158c738e5cea1ae3f76c65ac6a375c"
server_key_iv: "d9f76c177f6838e07424f789e0bf79c1"
server_key_version: "encryptionkey@0"
I20260811 14:25:54.690842 24398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 14:25:54.691574 24414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:54.691744 24398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:54.691835 24398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "4ff0579b7a84460886832b5c15fefc7e"
format_stamp: "Formatted at 2026-08-11 14:25:54 on dist-test-slave-cbbz"
server_key: "64158c738e5cea1ae3f76c65ac6a375c"
server_key_iv: "d9f76c177f6838e07424f789e0bf79c1"
server_key_version: "encryptionkey@0"
I20260811 14:25:54.691920 24398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:54.705704 24398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:54.707510 24398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:54.707672 24398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:54.711683 24398 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37731
I20260811 14:25:54.711714 24473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37731 every 8 connection(s)
I20260811 14:25:54.712056 24398 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:54.713317 24474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:54.715595 24474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e: Bootstrap starting.
I20260811 14:25:54.716262 24474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:54.716300 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24398
I20260811 14:25:54.716406 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:54.716607 21011 external_mini_cluster.cc:1428] Setting key 4e3fa659a476c030c9dd464f86401d76
I20260811 14:25:54.716602 24474 log.cc:824] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:54.717474 24474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e: No bootstrap required, opened a new log
I20260811 14:25:54.719072 24474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ff0579b7a84460886832b5c15fefc7e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37731 } }
I20260811 14:25:54.719249 24474 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:54.719307 24474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ff0579b7a84460886832b5c15fefc7e, State: Initialized, Role: FOLLOWER
I20260811 14:25:54.719439 24474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ff0579b7a84460886832b5c15fefc7e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37731 } }
I20260811 14:25:54.719532 24474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:54.719578 24474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:54.719627 24474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:54.720928 24474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ff0579b7a84460886832b5c15fefc7e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37731 } }
I20260811 14:25:54.721057 24474 leader_election.cc:302] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ff0579b7a84460886832b5c15fefc7e; no voters:
I20260811 14:25:54.721258 24474 leader_election.cc:288] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:54.721314 24479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:54.721460 24479 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [term 1 LEADER]: Becoming Leader. State: Replica: 4ff0579b7a84460886832b5c15fefc7e, State: Running, Role: LEADER
I20260811 14:25:54.721514 24474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:54.721678 24479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ff0579b7a84460886832b5c15fefc7e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37731 } }
I20260811 14:25:54.722255 24481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ff0579b7a84460886832b5c15fefc7e. Latest consensus state: current_term: 1 leader_uuid: "4ff0579b7a84460886832b5c15fefc7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ff0579b7a84460886832b5c15fefc7e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37731 } } }
I20260811 14:25:54.722345 24481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:54.722620 24480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ff0579b7a84460886832b5c15fefc7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ff0579b7a84460886832b5c15fefc7e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37731 } } }
I20260811 14:25:54.722731 24480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:54.722906 24488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:54.723413 24488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:54.725225 24488 catalog_manager.cc:1347] Generated new cluster ID: 1d65925df2734c5682708ceac739d220
I20260811 14:25:54.725282 24488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:25:54 dist-test-slave-cbbz krb5kdc[24383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:54.730456 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:54.717263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32814 (local address 127.20.132.254:37731)
0811 14:25:54.717432 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:54.717440 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:54.719443 (+ 2003us) server_negotiation.cc:407] Connection header received
0811 14:25:54.719595 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:54.719603 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:54.719658 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:54.719799 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:54.720725 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:54.721996 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:54.723088 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:54.723685 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:54.723808 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:54.726487 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:54.726491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:54.726491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:54.726503 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:54.728296 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:54.728733 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:54.728736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:54.728736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:54.728874 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:54.729083 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:54.729084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:54.729085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:54.729429 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:54.729600 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:54.730137 (+ 537us) server_negotiation.cc:299] Negotiation successful
0811 14:25:54.730310 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260811 14:25:54.737324 24488 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:54.737849 24488 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:54.741680 24488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ff0579b7a84460886832b5c15fefc7e: Generated new TSK 0
I20260811 14:25:54.741869 24488 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:54.767390 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37731
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:54.849381 24501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:54.849637 24501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:54.849677 24501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:54.850862 24501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:54.850934 24501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:54.850978 24501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:54.852520 24501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:54.852803 24501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:54.853048 24501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:54.858114 24512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:54.858126 24508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:54.858129 24509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:54.858160 24501 server_base.cc:1034] running on GCE node
I20260811 14:25:54.858513 24501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:54.858783 24501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:54.859951 24501 hybrid_clock.cc:648] HybridClock initialized: now 1786458354859935 us; error 28 us; skew 500 ppm
Aug 11 14:25:54 dist-test-slave-cbbz krb5kdc[24383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458354, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:54.862830 24501 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:54.863270 24501 webserver.cc:460] Webserver started at http://127.20.132.193:43455/ using document root <none> and password file <none>
I20260811 14:25:54.863518 24501 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:54.863588 24501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:54.863754 24501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:54.864872 24501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "2a456d459b12449490cd67ba24f13013"
format_stamp: "Formatted at 2026-08-11 14:25:54 on dist-test-slave-cbbz"
server_key: "db5d3ff40acc28d539169eba1d16c3d0"
server_key_iv: "16c25a81f53d0b25834aeeee6c93f049"
server_key_version: "encryptionkey@0"
I20260811 14:25:54.865236 24501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "2a456d459b12449490cd67ba24f13013"
format_stamp: "Formatted at 2026-08-11 14:25:54 on dist-test-slave-cbbz"
server_key: "db5d3ff40acc28d539169eba1d16c3d0"
server_key_iv: "16c25a81f53d0b25834aeeee6c93f049"
server_key_version: "encryptionkey@0"
I20260811 14:25:54.866600 24501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:54.867415 24520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:54.867606 24501 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:54.867726 24501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "2a456d459b12449490cd67ba24f13013"
format_stamp: "Formatted at 2026-08-11 14:25:54 on dist-test-slave-cbbz"
server_key: "db5d3ff40acc28d539169eba1d16c3d0"
server_key_iv: "16c25a81f53d0b25834aeeee6c93f049"
server_key_version: "encryptionkey@0"
I20260811 14:25:54.867805 24501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:54.885738 24501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:54.888311 24501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:54.888487 24501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:54.888765 24501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:54.889107 24501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:54.889163 24501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:54.889210 24501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:54.889233 24501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:54.895644 24501 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:40813
I20260811 14:25:54.895749 24640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:40813 every 8 connection(s)
I20260811 14:25:54.896108 24501 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:25:54 dist-test-slave-cbbz krb5kdc[24383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458354, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:54.902855 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24501
I20260811 14:25:54.902973 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:54.903170 21011 external_mini_cluster.cc:1428] Setting key f17715de20e602ff133cb490373ce9fa
I20260811 14:25:54.906309 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:54.896913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:50287 (local address 127.20.132.254:37731)
0811 14:25:54.896965 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:54.896967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:54.897190 (+ 223us) server_negotiation.cc:407] Connection header received
0811 14:25:54.897761 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:54.897762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:54.897778 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:54.897845 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:54.898864 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:54.899402 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:54.900465 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:54.900716 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:54.900806 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:54.903014 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:54.903015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:54.903016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:54.903023 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:54.904814 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:54.905238 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:54.905239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:54.905239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:54.905308 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:54.905546 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:54.905546 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:54.905547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:54.905691 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:54.905802 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:54.906159 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 14:25:54.906244 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:25:54.906612 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:54.896878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37731 (local address 127.20.132.193:50287)
0811 14:25:54.897063 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:54.897100 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:54.897647 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:54.897918 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:54.897923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:54.898525 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:54.898753 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:54.898758 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:54.899514 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:54.899516 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:54.900369 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:54.900371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:54.900819 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:54.900820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:54.900965 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:54.901443 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:54.901451 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:54.902907 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:54.904910 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:54.904917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:54.904919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:54.905155 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:54.905375 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:54.905376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:54.905376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:54.905480 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:54.905801 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:54.905808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:54.905993 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 14:25:54.906150 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 14:25:54.906340 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260811 14:25:54.907189 24641 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37731
I20260811 14:25:54.907291 24641 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:54.907502 24641 heartbeater.cc:511] Master 127.20.132.254:37731 requested a full tablet report, sending...
I20260811 14:25:54.908030 24434 ts_manager.cc:194] Registered new tserver with Master: 2a456d459b12449490cd67ba24f13013 (127.20.132.193:40813)
I20260811 14:25:54.908771 24434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:50287
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:54.931200 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37731
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:55.013614 24646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:55.013870 24646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:55.013906 24646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:55.015043 24646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:55.015116 24646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:55.015158 24646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:55.016588 24646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:55.016850 24646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:55.017079 24646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:55.022115 24652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:55.022179 24656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:55.022349 24646 server_base.cc:1034] running on GCE node
W20260811 14:25:55.022384 24653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:55.022581 24646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:55.022789 24646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:55.023926 24646 hybrid_clock.cc:648] HybridClock initialized: now 1786458355023918 us; error 35 us; skew 500 ppm
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458355, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:55.026341 24646 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:55.026789 24646 webserver.cc:460] Webserver started at http://127.20.132.194:41197/ using document root <none> and password file <none>
I20260811 14:25:55.026965 24646 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:55.027005 24646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:55.027091 24646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:55.028059 24646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "c2ea221629354422945ff68bc6bf736e"
format_stamp: "Formatted at 2026-08-11 14:25:55 on dist-test-slave-cbbz"
server_key: "fc50994821372611deb3d4ea50b20967"
server_key_iv: "31df520c14b754ea44625d5cb6cc7cb0"
server_key_version: "encryptionkey@0"
I20260811 14:25:55.028427 24646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "c2ea221629354422945ff68bc6bf736e"
format_stamp: "Formatted at 2026-08-11 14:25:55 on dist-test-slave-cbbz"
server_key: "fc50994821372611deb3d4ea50b20967"
server_key_iv: "31df520c14b754ea44625d5cb6cc7cb0"
server_key_version: "encryptionkey@0"
I20260811 14:25:55.029671 24646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:55.030365 24663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:55.030519 24646 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:55.030601 24646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "c2ea221629354422945ff68bc6bf736e"
format_stamp: "Formatted at 2026-08-11 14:25:55 on dist-test-slave-cbbz"
server_key: "fc50994821372611deb3d4ea50b20967"
server_key_iv: "31df520c14b754ea44625d5cb6cc7cb0"
server_key_version: "encryptionkey@0"
I20260811 14:25:55.030654 24646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:55.055687 24646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:55.057641 24646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:55.057758 24646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:55.057960 24646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:55.058229 24646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:55.058261 24646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:55.058283 24646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:55.058296 24646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:55.064345 24646 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:41695
I20260811 14:25:55.064424 24785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:41695 every 8 connection(s)
I20260811 14:25:55.064747 24646 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:55.066771 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24646
I20260811 14:25:55.066859 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:55.067042 21011 external_mini_cluster.cc:1428] Setting key d67ab3620b1d0c3bf499fec07a98234d
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458355, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:55.075417 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:55.065527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:33683 (local address 127.20.132.254:37731)
0811 14:25:55.065610 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:55.065613 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:55.065773 (+ 160us) server_negotiation.cc:407] Connection header received
0811 14:25:55.066269 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:55.066271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:55.066280 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:55.066332 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:55.067433 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.068074 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.069626 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.069937 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.070014 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:55.072312 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:55.072313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:55.072314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:55.072321 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:55.073996 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:55.074389 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:55.074390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:55.074391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:55.074459 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:55.074716 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:55.074717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:55.074718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:55.074875 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:55.074951 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:55.075188 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 14:25:55.075290 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:25:55.075433 24788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:55.065470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37731 (local address 127.20.132.194:33683)
0811 14:25:55.065652 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:55.065689 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:55.066190 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:55.066394 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:55.066397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:55.067048 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:55.067312 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:55.067321 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.068195 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.068197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:55.069530 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:55.069534 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.070021 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.070022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:55.070126 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:55.070683 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:55.070691 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:55.072218 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:55.074078 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:55.074084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:55.074086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:55.074310 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:55.074528 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:55.074528 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:55.074529 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:55.074649 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:55.074942 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:55.074946 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:55.075056 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 14:25:55.075138 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 14:25:55.075257 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":98,"threads_started":1}
I20260811 14:25:55.075925 24786 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37731
I20260811 14:25:55.076035 24786 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:55.076242 24786 heartbeater.cc:511] Master 127.20.132.254:37731 requested a full tablet report, sending...
I20260811 14:25:55.076647 24434 ts_manager.cc:194] Registered new tserver with Master: c2ea221629354422945ff68bc6bf736e (127.20.132.194:41695)
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
I20260811 14:25:55.077049 24434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:33683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:55.094779 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37731
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:45557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:55.179479 24793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:55.179682 24793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:55.179708 24793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:55.180886 24793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:55.180928 24793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:55.180954 24793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:55.182349 24793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:45557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:55.182544 24793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:55.182730 24793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:55.187700 24800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:55.187736 24799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:55.187903 24793 server_base.cc:1034] running on GCE node
W20260811 14:25:55.187963 24802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:55.188231 24793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:55.188483 24793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:55.189646 24793 hybrid_clock.cc:648] HybridClock initialized: now 1786458355189637 us; error 41 us; skew 500 ppm
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458355, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:55.192214 24793 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:55.192587 24793 webserver.cc:460] Webserver started at http://127.20.132.195:43749/ using document root <none> and password file <none>
I20260811 14:25:55.192778 24793 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:55.192819 24793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:55.192909 24793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:55.193869 24793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "05468d32f2d4464ca81ea93fd7ba90ec"
format_stamp: "Formatted at 2026-08-11 14:25:55 on dist-test-slave-cbbz"
server_key: "5e8848f9077df0c139227cb4f70095fc"
server_key_iv: "a11204b259262496bd09f2a9511eea26"
server_key_version: "encryptionkey@0"
I20260811 14:25:55.194178 24793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "05468d32f2d4464ca81ea93fd7ba90ec"
format_stamp: "Formatted at 2026-08-11 14:25:55 on dist-test-slave-cbbz"
server_key: "5e8848f9077df0c139227cb4f70095fc"
server_key_iv: "a11204b259262496bd09f2a9511eea26"
server_key_version: "encryptionkey@0"
I20260811 14:25:55.195572 24793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:25:55.196437 24809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:55.196594 24793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:55.196667 24793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "05468d32f2d4464ca81ea93fd7ba90ec"
format_stamp: "Formatted at 2026-08-11 14:25:55 on dist-test-slave-cbbz"
server_key: "5e8848f9077df0c139227cb4f70095fc"
server_key_iv: "a11204b259262496bd09f2a9511eea26"
server_key_version: "encryptionkey@0"
I20260811 14:25:55.196719 24793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:55.210495 24793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:55.212730 24793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:55.212843 24793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:55.213016 24793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:55.213267 24793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:55.213299 24793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:55.213320 24793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:55.213333 24793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:55.219455 24793 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:39549
I20260811 14:25:55.219537 24936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:39549 every 8 connection(s)
I20260811 14:25:55.219830 24793 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458355, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:55.229789 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:55.220517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:52073 (local address 127.20.132.254:37731)
0811 14:25:55.220580 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:55.220582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:55.220803 (+ 221us) server_negotiation.cc:407] Connection header received
0811 14:25:55.221397 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:55.221399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:55.221411 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:55.221472 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:55.222578 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.223258 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.224310 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.224515 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.224608 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:55.226677 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:55.226679 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:55.226679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:55.226687 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:55.228420 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:55.228823 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:55.228825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:55.228825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:55.228881 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:55.229145 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:55.229145 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:55.229146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:55.229268 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:55.229335 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:55.229616 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 14:25:55.229697 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:25:55.229979 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:55.220487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37731 (local address 127.20.132.195:52073)
0811 14:25:55.220680 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:55.220722 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:55.221296 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:55.221541 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:55.221545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:55.222243 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:55.222483 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:55.222488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.223365 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.223366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:55.224224 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:55.224227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.224621 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.224622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:55.224767 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:55.225203 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:55.225212 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:55.226580 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:55.228508 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:55.228515 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:55.228517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:55.228744 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:55.228954 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:55.228954 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:55.228955 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:55.229068 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:55.229337 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:55.229345 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:55.229478 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 14:25:55.229579 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 14:25:55.229742 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
I20260811 14:25:55.229964 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24793
I20260811 14:25:55.230073 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:55.230291 21011 external_mini_cluster.cc:1428] Setting key 74a262d32d57daeb1308569edd2abfd6
I20260811 14:25:55.230698 24937 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37731
I20260811 14:25:55.230808 24937 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:55.230991 24937 heartbeater.cc:511] Master 127.20.132.254:37731 requested a full tablet report, sending...
I20260811 14:25:55.231513 24434 ts_manager.cc:194] Registered new tserver with Master: 05468d32f2d4464ca81ea93fd7ba90ec (127.20.132.195:39549)
I20260811 14:25:55.231906 24434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:52073
I20260811 14:25:55.242419 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458355, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458355, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:55.265486 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:55.258379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32822 (local address 127.20.132.254:37731)
0811 14:25:55.258545 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:55.258547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:55.258559 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:25:55.258586 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:55.258587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:55.258596 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:55.258659 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:55.259254 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.259761 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.260566 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:55.260765 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:55.260824 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:55.262964 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:55.262965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:55.262965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:55.262972 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:55.264503 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:55.264815 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:55.264817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:55.264817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:55.264869 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:55.265034 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:55.265034 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:55.265035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:55.265199 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:55.265279 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:55.265361 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 14:25:55.265419 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
W20260811 14:25:55.265762 24434 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:32822
I20260811 14:25:55.266256 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24501
I20260811 14:25:55.274384 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24646
I20260811 14:25:55.280766 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24793
I20260811 14:25:55.286954 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24398
2026-08-11T14:25:55Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1907 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24951](info): set up 2 sockets
Aug 11 14:25:55 dist-test-slave-cbbz krb5kdc[24951](info): commencing operation
krb5kdc: starting...
W20260811 14:25:56.386966 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:56 dist-test-slave-cbbz krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:56.511291 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:39799
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:39799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:56.592767 24965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:56.593007 24965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:56.593046 24965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:56.594228 24965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:56.594300 24965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:56.594323 24965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:56.594343 24965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:56.594374 24965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:56.595841 24965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:39799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:39799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:56.596117 24965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:56.596367 24965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:56.601255 24971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:56.601275 24974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:56.601365 24972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:56.601648 24965 server_base.cc:1034] running on GCE node
I20260811 14:25:56.601893 24965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:56.602222 24965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:56.603394 24965 hybrid_clock.cc:648] HybridClock initialized: now 1786458356603377 us; error 46 us; skew 500 ppm
Aug 11 14:25:56 dist-test-slave-cbbz krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:56.605857 24965 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:56.606325 24965 webserver.cc:460] Webserver started at http://127.20.132.254:36137/ using document root <none> and password file <none>
I20260811 14:25:56.606545 24965 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:56.606621 24965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:56.606770 24965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:56.607820 24965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "299e94061e6db99766899ff97eb3e732"
server_key_iv: "1d62ca1677253fa24c5bafa6f185a313"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.608238 24965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "299e94061e6db99766899ff97eb3e732"
server_key_iv: "1d62ca1677253fa24c5bafa6f185a313"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.609664 24965 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:56.610450 24982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:56.610620 24965 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:56.610733 24965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "299e94061e6db99766899ff97eb3e732"
server_key_iv: "1d62ca1677253fa24c5bafa6f185a313"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.610817 24965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:56.623255 24965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:56.625340 24965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:56.625506 24965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:56.629691 24965 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:39799
I20260811 14:25:56.629751 25039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:39799 every 8 connection(s)
I20260811 14:25:56.630220 24965 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:56.630875 25040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:56.633106 25040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6: Bootstrap starting.
I20260811 14:25:56.633697 25040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:56.633986 25040 log.cc:824] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:56.634658 25040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6: No bootstrap required, opened a new log
I20260811 14:25:56.635812 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 24965
I20260811 14:25:56.635898 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:56.636086 21011 external_mini_cluster.cc:1428] Setting key 03b4be2c344793bd4ca3b5d35499cd18
I20260811 14:25:56.636441 25040 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39799 } }
I20260811 14:25:56.636706 25040 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:56.636780 25040 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6ec5ea8ad8c402fae4739b4e3908ca6, State: Initialized, Role: FOLLOWER
I20260811 14:25:56.636937 25040 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39799 } }
I20260811 14:25:56.637023 25040 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:56.637063 25040 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:56.637122 25040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:56.637759 25040 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39799 } }
I20260811 14:25:56.637872 25040 leader_election.cc:302] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6ec5ea8ad8c402fae4739b4e3908ca6; no voters:
I20260811 14:25:56.638063 25040 leader_election.cc:288] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:56.638125 25046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:56.638317 25046 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [term 1 LEADER]: Becoming Leader. State: Replica: a6ec5ea8ad8c402fae4739b4e3908ca6, State: Running, Role: LEADER
I20260811 14:25:56.638360 25040 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:56.638494 25046 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39799 } }
I20260811 14:25:56.640285 25047 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6ec5ea8ad8c402fae4739b4e3908ca6. Latest consensus state: current_term: 1 leader_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39799 } } }
I20260811 14:25:56.640552 25047 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [sys.catalog]: This master's current role is: LEADER
W20260811 14:25:56.640414 25063 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:25:56.640812 25063 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:25:56.644263 25048 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ec5ea8ad8c402fae4739b4e3908ca6" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39799 } } }
I20260811 14:25:56.644381 25048 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6 [sys.catalog]: This master's current role is: LEADER
Aug 11 14:25:56 dist-test-slave-cbbz krb5kdc[24951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:56.646749 25065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:56.646929 25065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:56.648605 25065 catalog_manager.cc:1347] Generated new cluster ID: dc15ee8d9ba74fb69993d33ea8d273bb
I20260811 14:25:56.648676 25065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:25:56.655280 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:56.636685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53900 (local address 127.20.132.254:39799)
0811 14:25:56.637465 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:56.637474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:56.637509 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:25:56.637632 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:56.637640 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:56.637697 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:56.637860 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:56.638735 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:56.641982 (+ 3247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:56.642984 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:56.643681 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:56.643791 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:56.651008 (+ 7217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:56.651013 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:56.651013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:56.651026 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:56.653446 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:56.653897 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:56.653900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:56.653901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:56.654024 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:56.654275 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:56.654276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:56.654277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:56.654608 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:56.654774 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:56.654895 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 14:25:56.655037 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":669,"threads_started":1}
I20260811 14:25:56.656054 25065 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:56.656575 25065 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:56.665102 25065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6ec5ea8ad8c402fae4739b4e3908ca6: Generated new TSK 0
I20260811 14:25:56.665295 25065 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:56.698714 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:39799
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:56.798662 25071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:56.798864 25071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:56.798888 25071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:56.800177 25071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:56.800220 25071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:56.800247 25071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:56.801838 25071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:39799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:56.802088 25071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:56.802340 25071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:56.807685 25082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:56.807726 25079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:56.807685 25078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:56.807948 25071 server_base.cc:1034] running on GCE node
I20260811 14:25:56.808226 25071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:56.808525 25071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:56.809700 25071 hybrid_clock.cc:648] HybridClock initialized: now 1786458356809678 us; error 39 us; skew 500 ppm
Aug 11 14:25:56 dist-test-slave-cbbz krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:56.815899 25071 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:56.816793 25071 webserver.cc:460] Webserver started at http://127.20.132.193:44939/ using document root <none> and password file <none>
I20260811 14:25:56.817106 25071 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:56.817188 25071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:56.817366 25071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:56.818491 25071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "1ba0a9589f83448f8ed7f7db3cfbaaa5"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "446f233e014b0b1976e3d1bbd41b5388"
server_key_iv: "7bf68dc3951d44cb75e15c24033334a3"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.818883 25071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "1ba0a9589f83448f8ed7f7db3cfbaaa5"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "446f233e014b0b1976e3d1bbd41b5388"
server_key_iv: "7bf68dc3951d44cb75e15c24033334a3"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.820343 25071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:56.821105 25089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:56.821300 25071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:56.821412 25071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "1ba0a9589f83448f8ed7f7db3cfbaaa5"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "446f233e014b0b1976e3d1bbd41b5388"
server_key_iv: "7bf68dc3951d44cb75e15c24033334a3"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.821487 25071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:56.829888 25071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:56.831872 25071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:56.832039 25071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:56.832311 25071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:56.832625 25071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:56.832680 25071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:56.832716 25071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:56.832762 25071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:56.839516 25071 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:43925
I20260811 14:25:56.839614 25210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:43925 every 8 connection(s)
I20260811 14:25:56.839916 25071 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:25:56.846022 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25071
Aug 11 14:25:56 dist-test-slave-cbbz krb5kdc[24951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:56.846153 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:56.846367 21011 external_mini_cluster.cc:1428] Setting key 6e4509142b6121335cc9fb91fe3179a2
I20260811 14:25:56.850031 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:56.840791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:58237 (local address 127.20.132.254:39799)
0811 14:25:56.840865 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:56.840867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:56.841076 (+ 209us) server_negotiation.cc:407] Connection header received
0811 14:25:56.842019 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:56.842019 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:56.842029 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:56.842080 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:56.842675 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:56.843171 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:56.844114 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:56.844398 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:56.844452 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:56.846657 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:56.846659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:56.846659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:56.846670 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:56.848474 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:56.848973 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:56.848974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:56.848975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:56.849042 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:56.849321 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:56.849322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:56.849322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:56.849478 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:56.849551 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:56.849809 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 14:25:56.849922 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:25:56.850042 25213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:56.840775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:39799 (local address 127.20.132.193:58237)
0811 14:25:56.840961 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:56.840998 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:56.841928 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:56.842137 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:56.842140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:56.842418 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:56.842605 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:56.842610 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:56.843267 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:56.843268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:56.844042 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:56.844044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:56.844470 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:56.844471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:56.844574 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:56.845033 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:56.845041 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:56.846550 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:56.848552 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:56.848559 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:56.848561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:56.848886 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:56.849148 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:56.849149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:56.849149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:56.849254 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:56.849545 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:56.849550 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:56.849668 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 14:25:56.849766 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 14:25:56.849886 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":99,"threads_started":1}
I20260811 14:25:56.850623 25211 heartbeater.cc:347] Connected to a master server at 127.20.132.254:39799
I20260811 14:25:56.850711 25211 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:56.850914 25211 heartbeater.cc:511] Master 127.20.132.254:39799 requested a full tablet report, sending...
I20260811 14:25:56.851465 25002 ts_manager.cc:194] Registered new tserver with Master: 1ba0a9589f83448f8ed7f7db3cfbaaa5 (127.20.132.193:43925)
I20260811 14:25:56.852129 25002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:58237
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:56.874879 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:39799
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:56.959625 25217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:56.959858 25217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:56.959896 25217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:56.961090 25217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:56.961208 25217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:56.961325 25217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:56.963047 25217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:39799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:56.963306 25217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:56.963552 25217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:56.968448 25223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:56.968521 25226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:56.968448 25224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:56.968706 25217 server_base.cc:1034] running on GCE node
I20260811 14:25:56.968899 25217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:56.969091 25217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:56.970320 25217 hybrid_clock.cc:648] HybridClock initialized: now 1786458356970295 us; error 37 us; skew 500 ppm
Aug 11 14:25:56 dist-test-slave-cbbz krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:56.972950 25217 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:56.973320 25217 webserver.cc:460] Webserver started at http://127.20.132.194:37349/ using document root <none> and password file <none>
I20260811 14:25:56.973491 25217 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:56.973531 25217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:56.973618 25217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:56.974558 25217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "6e13d35a0fa440a6bc76b7bc405a7411"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "11e6ff7be4f31ff00dfcde161a96b03a"
server_key_iv: "390f29122e130f57e06c9652b04ebce9"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.974857 25217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "6e13d35a0fa440a6bc76b7bc405a7411"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "11e6ff7be4f31ff00dfcde161a96b03a"
server_key_iv: "390f29122e130f57e06c9652b04ebce9"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.976233 25217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:25:56.976945 25233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:56.977174 25217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:56.977298 25217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "6e13d35a0fa440a6bc76b7bc405a7411"
format_stamp: "Formatted at 2026-08-11 14:25:56 on dist-test-slave-cbbz"
server_key: "11e6ff7be4f31ff00dfcde161a96b03a"
server_key_iv: "390f29122e130f57e06c9652b04ebce9"
server_key_version: "encryptionkey@0"
I20260811 14:25:56.977380 25217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:56.995923 25217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:56.998178 25217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:56.998329 25217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:56.998564 25217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:56.998881 25217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:56.998916 25217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:56.998939 25217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:56.998983 25217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:57.004871 25217 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:41157
I20260811 14:25:57.004954 25354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:41157 every 8 connection(s)
I20260811 14:25:57.005254 25217 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:57.009775 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25217
I20260811 14:25:57.009905 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:57.010113 21011 external_mini_cluster.cc:1428] Setting key 3bccd551ced935da27d6f43c30bc9a10
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[24951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458356, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:57.015623 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:57.006003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:46439 (local address 127.20.132.254:39799)
0811 14:25:57.006048 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:57.006051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:57.006252 (+ 201us) server_negotiation.cc:407] Connection header received
0811 14:25:57.007223 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:57.007224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:57.007238 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:57.007304 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:57.007937 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.008529 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.009556 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.009783 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.009863 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:57.012406 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:57.012408 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:57.012408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:57.012417 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:57.014065 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.014591 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.014592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.014592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.014655 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.014951 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.014952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.014953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.015081 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:57.015138 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:57.015484 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 14:25:57.015549 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:25:57.015915 25358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:57.005952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:39799 (local address 127.20.132.194:46439)
0811 14:25:57.006121 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:57.006161 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:57.007104 (+ 943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:57.007374 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:57.007380 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:57.007646 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:57.007833 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:57.007837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.008649 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.008650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:57.009460 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:57.009463 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.009870 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.009871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:57.010029 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:57.010633 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:57.010641 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:57.012303 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:57.014155 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:57.014183 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:57.014185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:57.014511 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:57.014721 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:57.014722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:57.014723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:57.014873 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:57.015160 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:57.015167 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:57.015342 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 14:25:57.015466 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 14:25:57.015645 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":68,"threads_started":1}
I20260811 14:25:57.016482 25356 heartbeater.cc:347] Connected to a master server at 127.20.132.254:39799
I20260811 14:25:57.016577 25356 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:57.016767 25356 heartbeater.cc:511] Master 127.20.132.254:39799 requested a full tablet report, sending...
I20260811 14:25:57.017163 25002 ts_manager.cc:194] Registered new tserver with Master: 6e13d35a0fa440a6bc76b7bc405a7411 (127.20.132.194:41157)
I20260811 14:25:57.017489 25002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:46439
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:57.037444 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:39799
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:57.119170 25361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:57.119411 25361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:57.119454 25361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:57.120646 25361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:57.120711 25361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:57.120759 25361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:57.122876 25361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:39799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:57.123159 25361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:57.123389 25361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:57.128599 25367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:57.128677 25368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:57.128854 25361 server_base.cc:1034] running on GCE node
W20260811 14:25:57.128675 25370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:57.129154 25361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:57.129413 25361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:57.130584 25361 hybrid_clock.cc:648] HybridClock initialized: now 1786458357130565 us; error 30 us; skew 500 ppm
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458357, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:57.133072 25361 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:57.133502 25361 webserver.cc:460] Webserver started at http://127.20.132.195:33567/ using document root <none> and password file <none>
I20260811 14:25:57.133751 25361 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:57.133821 25361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:57.133968 25361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:57.135022 25361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "9f043c9ba7ec453386ef29048e5d15b9"
format_stamp: "Formatted at 2026-08-11 14:25:57 on dist-test-slave-cbbz"
server_key: "94f365bba8e6cacaf7a13f414dda0c0d"
server_key_iv: "507e8180e57520c654be579936b66746"
server_key_version: "encryptionkey@0"
I20260811 14:25:57.135401 25361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "9f043c9ba7ec453386ef29048e5d15b9"
format_stamp: "Formatted at 2026-08-11 14:25:57 on dist-test-slave-cbbz"
server_key: "94f365bba8e6cacaf7a13f414dda0c0d"
server_key_iv: "507e8180e57520c654be579936b66746"
server_key_version: "encryptionkey@0"
I20260811 14:25:57.136844 25361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:25:57.137567 25379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:57.137737 25361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:57.137837 25361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "9f043c9ba7ec453386ef29048e5d15b9"
format_stamp: "Formatted at 2026-08-11 14:25:57 on dist-test-slave-cbbz"
server_key: "94f365bba8e6cacaf7a13f414dda0c0d"
server_key_iv: "507e8180e57520c654be579936b66746"
server_key_version: "encryptionkey@0"
I20260811 14:25:57.137921 25361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:57.149298 25361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:57.151252 25361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:57.151434 25361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:57.151710 25361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:57.152043 25361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:57.152097 25361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:57.152254 25361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:57.152288 25361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:57.158583 25361 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:34649
I20260811 14:25:57.158624 25496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:34649 every 8 connection(s)
I20260811 14:25:57.158981 25361 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:57.162735 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25361
I20260811 14:25:57.162850 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:57.163054 21011 external_mini_cluster.cc:1428] Setting key bed94f9182cce0e0dd8b156b67f02627
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[24951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458357, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:57.169665 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:57.159890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:48705 (local address 127.20.132.254:39799)
0811 14:25:57.159968 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:57.159971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:57.160186 (+ 215us) server_negotiation.cc:407] Connection header received
0811 14:25:57.161216 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:57.161217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:57.161231 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:57.161291 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:57.161953 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.162478 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.163854 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.164240 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.164300 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:57.166679 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:57.166681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:57.166681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:57.166689 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:57.168219 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.168652 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.168653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.168654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.168714 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.168992 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.168993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.168993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.169115 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:57.169189 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:57.169477 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 14:25:57.169572 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:25:57.169876 25500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:57.159789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:39799 (local address 127.20.132.195:48705)
0811 14:25:57.160015 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:57.160070 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:57.161093 (+ 1023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:57.161359 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:57.161363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:57.161637 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:57.161853 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:57.161858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.162596 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.162597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:57.163780 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:57.163783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.164318 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.164319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:57.164431 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:57.165105 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:57.165116 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:57.166561 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:57.168317 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:57.168325 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:57.168327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:57.168559 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:57.168784 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:57.168785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:57.168785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:57.168914 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:57.169193 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:57.169200 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:57.169342 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 14:25:57.169459 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 14:25:57.169623 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":115,"threads_started":1}
I20260811 14:25:57.170380 25498 heartbeater.cc:347] Connected to a master server at 127.20.132.254:39799
I20260811 14:25:57.170491 25498 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:57.170694 25498 heartbeater.cc:511] Master 127.20.132.254:39799 requested a full tablet report, sending...
I20260811 14:25:57.171073 25002 ts_manager.cc:194] Registered new tserver with Master: 9f043c9ba7ec453386ef29048e5d15b9 (127.20.132.195:34649)
I20260811 14:25:57.171458 25002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:48705
I20260811 14:25:57.174670 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[24951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:25:57.200973 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:57.192230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46380 (local address 127.20.132.193:43925)
0811 14:25:57.192414 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:57.192421 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:57.192450 (+ 29us) server_negotiation.cc:407] Connection header received
0811 14:25:57.192487 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:57.192489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:57.192504 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:57.192594 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:57.193283 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.194086 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.194918 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.195280 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.195368 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:57.197916 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:57.197932 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:57.197932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:57.197939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:57.199623 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.200127 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.200131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.200131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.200253 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.200452 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.200453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.200453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.200593 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:57.200716 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:57.200782 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 14:25:57.200850 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[24951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:57.209940 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:57.202487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53912 (local address 127.20.132.254:39799)
0811 14:25:57.202569 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:57.202571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:57.202581 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:57.202646 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:57.202647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:57.202658 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:57.202721 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:57.203282 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.203828 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.204731 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:57.204959 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:57.205044 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:57.207268 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:57.207271 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:57.207271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:57.207279 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:57.208633 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.208989 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.208990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.208991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.209054 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:57.209285 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:57.209285 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:57.209286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:57.209455 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:57.209570 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:57.209721 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 14:25:57.209809 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 14:25:57.210258 25002 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53912
I20260811 14:25:57.210650 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25071
I20260811 14:25:57.216459 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25217
I20260811 14:25:57.225420 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25361
I20260811 14:25:57.233687 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 24965
2026-08-11T14:25:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1950 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[25510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[25510](info): set up 2 sockets
Aug 11 14:25:57 dist-test-slave-cbbz krb5kdc[25510](info): commencing operation
krb5kdc: starting...
W20260811 14:25:58.351851 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:25:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:25:58.474920 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:42897
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:58.555960 25524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:58.556171 25524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:58.556195 25524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:58.557328 25524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:58.557369 25524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:58.557384 25524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:58.557395 25524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:58.557430 25524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:58.558909 25524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:42897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:58.559162 25524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:58.559403 25524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:58.564023 25533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:58.564023 25531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:58.564117 25530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:58.564558 25524 server_base.cc:1034] running on GCE node
I20260811 14:25:58.564838 25524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:58.565148 25524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:58.566340 25524 hybrid_clock.cc:648] HybridClock initialized: now 1786458358566325 us; error 50 us; skew 500 ppm
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:58.572677 25524 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:25:58.573081 25524 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:58.573156 25524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:58.573315 25524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:58.574404 25524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "aeb76a4237cf478f8a0f69efec8fb856"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "da59d6212e73d1b655650ab4b7231e70"
server_key_iv: "f272db0808ca507243fc18d550cc6d90"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.574764 25524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "aeb76a4237cf478f8a0f69efec8fb856"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "da59d6212e73d1b655650ab4b7231e70"
server_key_iv: "f272db0808ca507243fc18d550cc6d90"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.576064 25524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:25:58.576833 25540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.576998 25524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:58.577097 25524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "aeb76a4237cf478f8a0f69efec8fb856"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "da59d6212e73d1b655650ab4b7231e70"
server_key_iv: "f272db0808ca507243fc18d550cc6d90"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.577174 25524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:58.598048 25524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:58.599912 25524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:58.600070 25524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:58.604431 25524 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:42897
I20260811 14:25:58.604457 25595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:42897 every 8 connection(s)
I20260811 14:25:58.604750 25524 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:58.605845 25596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:58.608074 25596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856: Bootstrap starting.
I20260811 14:25:58.608696 25596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:58.608937 25596 log.cc:824] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:58.609566 25596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856: No bootstrap required, opened a new log
I20260811 14:25:58.610069 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25524
I20260811 14:25:58.610188 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:58.610371 21011 external_mini_cluster.cc:1428] Setting key f073fc0b0459fb9c7f4f209e9d09345a
I20260811 14:25:58.612008 25596 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb76a4237cf478f8a0f69efec8fb856" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42897 } }
I20260811 14:25:58.612232 25596 raft_consensus.cc:374] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:58.612287 25596 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb76a4237cf478f8a0f69efec8fb856, State: Initialized, Role: FOLLOWER
I20260811 14:25:58.612424 25596 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb76a4237cf478f8a0f69efec8fb856" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42897 } }
I20260811 14:25:58.612512 25596 raft_consensus.cc:388] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:58.612547 25596 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:58.612603 25596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:58.613245 25596 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb76a4237cf478f8a0f69efec8fb856" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42897 } }
I20260811 14:25:58.613332 25596 leader_election.cc:302] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aeb76a4237cf478f8a0f69efec8fb856; no voters:
I20260811 14:25:58.613533 25596 leader_election.cc:288] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:58.613570 25603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:58.613684 25603 raft_consensus.cc:686] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [term 1 LEADER]: Becoming Leader. State: Replica: aeb76a4237cf478f8a0f69efec8fb856, State: Running, Role: LEADER
I20260811 14:25:58.613804 25596 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:58.613833 25603 consensus_queue.cc:237] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb76a4237cf478f8a0f69efec8fb856" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42897 } }
I20260811 14:25:58.614127 25603 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aeb76a4237cf478f8a0f69efec8fb856. Latest consensus state: current_term: 1 leader_uuid: "aeb76a4237cf478f8a0f69efec8fb856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb76a4237cf478f8a0f69efec8fb856" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42897 } } }
I20260811 14:25:58.614319 25603 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:58.614143 25604 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aeb76a4237cf478f8a0f69efec8fb856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb76a4237cf478f8a0f69efec8fb856" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42897 } } }
I20260811 14:25:58.614909 25611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:58.615376 25611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:58.615921 25604 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:58.616968 25611 catalog_manager.cc:1347] Generated new cluster ID: 30ee7d4704cd474c86ce1b4204494c77
I20260811 14:25:58.617952 25611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:58.622684 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:58.610908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.20.132.254:42897)
0811 14:25:58.611102 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:58.611110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:58.611135 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:25:58.611936 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:58.611944 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:58.611991 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:58.612113 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:58.612971 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.614142 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.615277 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.615873 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.615988 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:58.619059 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:58.619063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:58.619064 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:58.619075 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:58.621020 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:58.621496 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:58.621498 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:58.621499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:58.621597 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:58.621829 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:58.621830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:58.621830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:58.622110 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:58.622253 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:58.622378 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 14:25:58.622502 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
I20260811 14:25:58.626091 25611 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:58.626593 25611 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:58.629698 25611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856: Generated new TSK 0
I20260811 14:25:58.629863 25611 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:25:58.662549 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42897
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:58.745354 25626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:58.745570 25626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:58.745594 25626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:58.746709 25626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:58.746747 25626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:58.746774 25626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:58.748319 25626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:58.748514 25626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:58.748692 25626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:58.753613 25632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:58.753640 25631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:58.753621 25634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:58.753906 25626 server_base.cc:1034] running on GCE node
I20260811 14:25:58.754154 25626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:58.754407 25626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:58.755607 25626 hybrid_clock.cc:648] HybridClock initialized: now 1786458358755581 us; error 36 us; skew 500 ppm
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:58.758265 25626 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:25:58.758576 25626 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:58.758628 25626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:58.758718 25626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:58.759752 25626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "ec0d0014be3c49ef99523d3edd5f5bad"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "7fd50b3591fa070fc951b23937dab3c7"
server_key_iv: "8be4b1fe07feb9a1afab81b2e301cd29"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.760066 25626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "ec0d0014be3c49ef99523d3edd5f5bad"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "7fd50b3591fa070fc951b23937dab3c7"
server_key_iv: "8be4b1fe07feb9a1afab81b2e301cd29"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.761478 25626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:58.762188 25641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.762372 25626 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:58.762445 25626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "ec0d0014be3c49ef99523d3edd5f5bad"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "7fd50b3591fa070fc951b23937dab3c7"
server_key_iv: "8be4b1fe07feb9a1afab81b2e301cd29"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.762498 25626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:58.770211 25626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:58.771890 25626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:58.771996 25626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:58.772223 25626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:58.772487 25626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:58.772518 25626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.772538 25626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:58.772552 25626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.778314 25626 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:45721
I20260811 14:25:58.778384 25770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:45721 every 8 connection(s)
I20260811 14:25:58.778657 25626 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:58.787581 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:58.779418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:35579 (local address 127.20.132.254:42897)
0811 14:25:58.779460 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:58.779462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:58.779662 (+ 200us) server_negotiation.cc:407] Connection header received
0811 14:25:58.780172 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:58.780173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:58.780190 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:58.780243 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:58.781232 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.781746 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.782749 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.782941 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.782991 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:58.785143 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:58.785145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:58.785145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:58.785153 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:58.786369 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:58.786723 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:58.786724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:58.786724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:58.786772 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:58.786983 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:58.786984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:58.786984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:58.787080 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:58.787134 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:58.787373 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 14:25:58.787470 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:25:58.787616 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25626
I20260811 14:25:58.787636 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:58.779368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42897 (local address 127.20.132.193:35579)
0811 14:25:58.779530 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:58.779571 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:58.780058 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:58.780326 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:58.780329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:58.780581 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:58.781151 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:58.781157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.781850 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.781851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:58.782670 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:58.782672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.783015 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.783016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:58.783113 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:58.783658 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:58.783666 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:58.785055 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:58.786444 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:58.786451 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:58.786452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:58.786658 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:58.786829 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:58.786830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:58.786830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:58.786930 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:58.787147 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:58.787152 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:58.787268 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 14:25:58.787349 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 14:25:58.787481 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260811 14:25:58.787714 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:58.787902 21011 external_mini_cluster.cc:1428] Setting key 55ff211fbbd02d25e37b98131df099ed
I20260811 14:25:58.788255 25771 heartbeater.cc:347] Connected to a master server at 127.20.132.254:42897
I20260811 14:25:58.788355 25771 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:58.788522 25771 heartbeater.cc:511] Master 127.20.132.254:42897 requested a full tablet report, sending...
I20260811 14:25:58.789060 25559 ts_manager.cc:194] Registered new tserver with Master: ec0d0014be3c49ef99523d3edd5f5bad (127.20.132.193:45721)
I20260811 14:25:58.789674 25559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:35579
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:25:58.813236 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42897
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:58.895964 25776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:58.896234 25776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:58.896265 25776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:58.897456 25776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:58.897496 25776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:58.897522 25776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:58.899021 25776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:58.899266 25776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:58.899501 25776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:58.904479 25782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:58.904495 25781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:58.904495 25784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:58.904728 25776 server_base.cc:1034] running on GCE node
I20260811 14:25:58.904922 25776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:58.905156 25776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:58.906328 25776 hybrid_clock.cc:648] HybridClock initialized: now 1786458358906307 us; error 32 us; skew 500 ppm
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:58.908951 25776 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:25:58.909301 25776 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:58.909374 25776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:58.909526 25776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:58.910573 25776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "f3b5db43bf3f4035b45516ffb22abe1c"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "39f896c0860837065816fba1c39bbeb1"
server_key_iv: "939427c27105eeaf6d993d4499253cec"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.910952 25776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "f3b5db43bf3f4035b45516ffb22abe1c"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "39f896c0860837065816fba1c39bbeb1"
server_key_iv: "939427c27105eeaf6d993d4499253cec"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.912381 25776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:58.913172 25790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.913367 25776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:58.913522 25776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "f3b5db43bf3f4035b45516ffb22abe1c"
format_stamp: "Formatted at 2026-08-11 14:25:58 on dist-test-slave-cbbz"
server_key: "39f896c0860837065816fba1c39bbeb1"
server_key_iv: "939427c27105eeaf6d993d4499253cec"
server_key_version: "encryptionkey@0"
I20260811 14:25:58.913584 25776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:58.923934 25776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:58.926249 25776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:58.926364 25776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:58.926589 25776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:58.926888 25776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:58.926920 25776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.926942 25776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:58.926955 25776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:58.933038 25776 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:34825
I20260811 14:25:58.933081 25917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:34825 every 8 connection(s)
I20260811 14:25:58.933343 25776 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:58.938334 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25776
I20260811 14:25:58.938418 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:58.938617 21011 external_mini_cluster.cc:1428] Setting key 13d2bceaac221d2c723cd18be9b1949b
Aug 11 14:25:58 dist-test-slave-cbbz krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458358, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:58.942660 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:58.934059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:45059 (local address 127.20.132.254:42897)
0811 14:25:58.934124 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:58.934127 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:58.934343 (+ 216us) server_negotiation.cc:407] Connection header received
0811 14:25:58.934835 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:58.934837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:58.934846 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:58.934907 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:58.935797 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.936352 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.937341 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.937530 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.937584 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:58.939883 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:58.939885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:58.939885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:58.939892 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:58.941265 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:58.941668 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:58.941670 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:58.941670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:58.941738 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:58.942014 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:58.942015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:58.942016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:58.942143 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:58.942222 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:58.942487 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 14:25:58.942566 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:25:58.942898 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:58.934013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42897 (local address 127.20.132.194:45059)
0811 14:25:58.934216 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:58.934257 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:58.934755 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:58.934970 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:58.934972 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:58.935220 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:58.935712 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:58.935717 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.936431 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.936432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:58.937264 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:58.937266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:58.937612 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:58.937613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:58.937710 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:58.938187 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:58.938195 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:58.939784 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:58.941354 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:58.941361 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:58.941364 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:58.941584 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:58.941835 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:58.941836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:58.941836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:58.941948 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:58.942212 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:58.942219 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:58.942358 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 14:25:58.942465 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 14:25:58.942634 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":133,"threads_started":1}
I20260811 14:25:58.943377 25918 heartbeater.cc:347] Connected to a master server at 127.20.132.254:42897
I20260811 14:25:58.943471 25918 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:58.943642 25918 heartbeater.cc:511] Master 127.20.132.254:42897 requested a full tablet report, sending...
I20260811 14:25:58.944046 25559 ts_manager.cc:194] Registered new tserver with Master: f3b5db43bf3f4035b45516ffb22abe1c (127.20.132.194:34825)
I20260811 14:25:58.944615 25559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:45059
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:25:58.966572 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42897
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:25:59.047772 25924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:59.047982 25924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:59.048007 25924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:59.049127 25924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:59.049162 25924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:59.049189 25924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:59.050621 25924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:59.050869 25924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:59.051103 25924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:59.056181 25930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.056130 25932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.056164 25929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:59.056774 25924 server_base.cc:1034] running on GCE node
I20260811 14:25:59.057004 25924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:59.057260 25924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:59.058409 25924 hybrid_clock.cc:648] HybridClock initialized: now 1786458359058383 us; error 45 us; skew 500 ppm
Aug 11 14:25:59 dist-test-slave-cbbz krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458359, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:25:59.061200 25924 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:25:59.061662 25924 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:59.061751 25924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:59.061908 25924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:59.062935 25924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "459104120b9c41339f02cdc1b0a26563"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "6b8bff318e8c1669495a7486f99ad82a"
server_key_iv: "624d71d8b48f488ab532184c43bdbc24"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.063300 25924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "459104120b9c41339f02cdc1b0a26563"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "6b8bff318e8c1669495a7486f99ad82a"
server_key_iv: "624d71d8b48f488ab532184c43bdbc24"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.064733 25924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:25:59.065502 25938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.065738 25924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:59.065812 25924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "459104120b9c41339f02cdc1b0a26563"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "6b8bff318e8c1669495a7486f99ad82a"
server_key_iv: "624d71d8b48f488ab532184c43bdbc24"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.065863 25924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:59.081157 25924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:59.083463 25924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:59.083571 25924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:59.083750 25924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:59.084007 25924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:59.084036 25924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.084059 25924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:59.084071 25924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.090216 25924 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43613
I20260811 14:25:59.090258 26069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43613 every 8 connection(s)
I20260811 14:25:59.090515 25924 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:59.091564 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 25924
I20260811 14:25:59.091679 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:59.091881 21011 external_mini_cluster.cc:1428] Setting key 41a1d51ba4a63c4363705eacd3b0f200
Aug 11 14:25:59 dist-test-slave-cbbz krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458359, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:25:59.099663 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.091193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:41339 (local address 127.20.132.254:42897)
0811 14:25:59.091258 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.091261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.091518 (+ 257us) server_negotiation.cc:407] Connection header received
0811 14:25:59.092169 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.092170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.092183 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.092246 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.093251 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.093788 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.094770 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.094976 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.095061 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.097041 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.097042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.097043 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:59.097063 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.098301 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:59.098692 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:59.098693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:59.098694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:59.098755 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:59.099024 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:59.099025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:59.099025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:59.099146 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.099226 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.099482 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.099569 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:25:59.099852 26072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.091181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42897 (local address 127.20.132.195:41339)
0811 14:25:59.091389 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.091424 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.092027 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.092384 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.092388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.092638 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.093151 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.093156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.093885 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.093885 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.094678 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.094679 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.095073 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.095074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.095199 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.095637 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:25:59.095645 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.096947 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.098387 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:59.098394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:59.098396 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:59.098615 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:59.098850 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:25:59.098851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:25:59.098852 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:25:59.098956 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:25:59.099216 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.099223 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.099356 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.099462 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.099622 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":131,"threads_started":1}
I20260811 14:25:59.100361 26070 heartbeater.cc:347] Connected to a master server at 127.20.132.254:42897
I20260811 14:25:59.100450 26070 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:59.100567 26070 heartbeater.cc:511] Master 127.20.132.254:42897 requested a full tablet report, sending...
I20260811 14:25:59.100917 25559 ts_manager.cc:194] Registered new tserver with Master: 459104120b9c41339f02cdc1b0a26563 (127.20.132.195:43613)
I20260811 14:25:59.101254 25559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:41339
I20260811 14:25:59.103807 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:25:59.111295 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.105529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35424 (local address 127.20.132.254:42897)
0811 14:25:59.105569 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.105571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.105652 (+ 81us) server_negotiation.cc:407] Connection header received
0811 14:25:59.105705 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.105706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.105715 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.105775 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.106315 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.106775 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.107547 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.107732 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.107795 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.108943 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.108944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.108945 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:25:59.108950 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.110346 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:59.110645 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:59.110645 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:59.110646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:59.110696 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:25:59.110843 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:25:59.110843 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:25:59.110844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:25:59.110981 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.111049 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.111162 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.111217 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:25:59.112905 25559 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:59.114604 25559 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:59.120980 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.116819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:34825 (local address 127.0.0.1:33740)
0811 14:25:59.117162 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.117205 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.117271 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.117541 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.117545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.117547 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:59.117615 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.117617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.118621 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.118622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.119701 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.119704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.120664 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.120665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.120762 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.120781 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.120846 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.120906 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":65,"threads_started":1}
I20260811 14:25:59.121071 26087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.117166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48854 (local address 127.20.132.193:45721)
0811 14:25:59.117386 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.117390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.117562 (+ 172us) server_negotiation.cc:407] Connection header received
0811 14:25:59.117606 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.117608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.117622 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.117693 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:59.117895 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.118974 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.120176 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.120718 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.120792 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.120847 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.120936 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.120977 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":90,"threads_started":1}
I20260811 14:25:59.121373 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.116957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33740 (local address 127.20.132.194:34825)
0811 14:25:59.117264 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.117269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.117281 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:25:59.117360 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.117362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.117379 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.117710 (+ 331us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:59.117798 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.118519 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.119796 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.120551 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.120631 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.120682 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.121242 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.121294 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":89,"threads_started":1}
I20260811 14:25:59.121387 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.117036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45721 (local address 127.0.0.1:48854)
0811 14:25:59.117442 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.117453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.117504 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.117782 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.117783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.117786 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:59.117824 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.117825 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.119083 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.119084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.120076 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.120078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.120792 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.120793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.120852 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.120856 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.120921 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.120962 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":26,"thread_start_us":52,"threads_started":1}
I20260811 14:25:59.121428 26086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.117049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48428 (local address 127.20.132.195:43613)
0811 14:25:59.117411 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.117464 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.117474 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:59.117520 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.117523 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.117539 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.117625 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:59.117850 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.118968 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.120311 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.121007 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.121069 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.121126 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.121302 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.121342 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":92,"threads_started":1}
I20260811 14:25:59.121385 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.116843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43613 (local address 127.0.0.1:48428)
0811 14:25:59.117162 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.117205 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.117271 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.117712 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.117713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.117715 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:59.117768 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.117769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.119105 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.119106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.120217 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.120220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.121158 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.121159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.121217 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.121220 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.121270 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.121308 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":7,"thread_start_us":50,"threads_started":1}
I20260811 14:25:59.122205 25695 tablet_service.cc:1467] Processing CreateTablet for tablet d07ed98bd6ad4a4b9d68b38ca58ed069 (DEFAULT_TABLE table=test-table [id=0b791e73bc574a4fa5c0927e8dfd9f77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:59.122239 25844 tablet_service.cc:1467] Processing CreateTablet for tablet d07ed98bd6ad4a4b9d68b38ca58ed069 (DEFAULT_TABLE table=test-table [id=0b791e73bc574a4fa5c0927e8dfd9f77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:59.122484 25695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d07ed98bd6ad4a4b9d68b38ca58ed069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.122417 25995 tablet_service.cc:1467] Processing CreateTablet for tablet d07ed98bd6ad4a4b9d68b38ca58ed069 (DEFAULT_TABLE table=test-table [id=0b791e73bc574a4fa5c0927e8dfd9f77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:59.122575 25844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d07ed98bd6ad4a4b9d68b38ca58ed069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.122702 25995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d07ed98bd6ad4a4b9d68b38ca58ed069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.125255 26088 tablet_bootstrap.cc:492] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad: Bootstrap starting.
I20260811 14:25:59.125803 26089 tablet_bootstrap.cc:492] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Bootstrap starting.
I20260811 14:25:59.125979 26088 tablet_bootstrap.cc:654] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.126016 26090 tablet_bootstrap.cc:492] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Bootstrap starting.
I20260811 14:25:59.126627 26090 tablet_bootstrap.cc:654] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.126701 26089 tablet_bootstrap.cc:654] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.126755 26088 log.cc:824] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.127297 26090 log.cc:824] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.127305 26089 log.cc:824] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.127622 26088 tablet_bootstrap.cc:492] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad: No bootstrap required, opened a new log
I20260811 14:25:59.127710 26088 ts_tablet_manager.cc:1397] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:25:59.127992 26090 tablet_bootstrap.cc:492] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: No bootstrap required, opened a new log
I20260811 14:25:59.128046 26090 ts_tablet_manager.cc:1397] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:25:59.128756 26089 tablet_bootstrap.cc:492] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: No bootstrap required, opened a new log
I20260811 14:25:59.128822 26089 ts_tablet_manager.cc:1397] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:25:59.129534 26090 raft_consensus.cc:348] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.129688 26090 raft_consensus.cc:374] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.129714 26090 raft_consensus.cc:729] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459104120b9c41339f02cdc1b0a26563, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.129840 26090 consensus_queue.cc:260] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.129850 26088 raft_consensus.cc:348] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.130013 26088 raft_consensus.cc:374] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.130048 26088 raft_consensus.cc:729] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0d0014be3c49ef99523d3edd5f5bad, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.130119 26090 ts_tablet_manager.cc:1428] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:25:59.130234 26070 heartbeater.cc:503] Master 127.20.132.254:42897 was elected leader, sending a full tablet report...
I20260811 14:25:59.130192 26088 consensus_queue.cc:260] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.130462 26088 ts_tablet_manager.cc:1428] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:25:59.130591 25771 heartbeater.cc:503] Master 127.20.132.254:42897 was elected leader, sending a full tablet report...
I20260811 14:25:59.130890 26089 raft_consensus.cc:348] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.131027 26089 raft_consensus.cc:374] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.131052 26089 raft_consensus.cc:729] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3b5db43bf3f4035b45516ffb22abe1c, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.131122 26089 consensus_queue.cc:260] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.131412 25918 heartbeater.cc:503] Master 127.20.132.254:42897 was elected leader, sending a full tablet report...
I20260811 14:25:59.131418 26089 ts_tablet_manager.cc:1428] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:25:59.156252 26094 raft_consensus.cc:482] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:59.156378 26094 raft_consensus.cc:504] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.156795 26094 leader_election.cc:288] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3b5db43bf3f4035b45516ffb22abe1c (127.20.132.194:34825), ec0d0014be3c49ef99523d3edd5f5bad (127.20.132.193:45721)
I20260811 14:25:59.160238 26087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.157248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:45867 (local address 127.20.132.193:45721)
0811 14:25:59.157307 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.157309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.157389 (+ 80us) server_negotiation.cc:407] Connection header received
0811 14:25:59.157460 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.157461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.157471 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.157543 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:59.157707 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.158208 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.159467 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.159856 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.159920 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.159927 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.160097 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.160169 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 14:25:59.160248 26097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.157126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45721 (local address 127.20.132.195:45867)
0811 14:25:59.157327 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.157337 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.157395 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.157549 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.157551 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.157553 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:59.157648 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.157651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.158301 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.158303 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.159366 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.159368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.159938 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.159939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.160008 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.160012 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.160073 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.160117 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":1,"thread_start_us":163,"threads_started":1}
I20260811 14:25:59.160832 25716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07ed98bd6ad4a4b9d68b38ca58ed069" candidate_uuid: "459104120b9c41339f02cdc1b0a26563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" is_pre_election: true
I20260811 14:25:59.161011 25716 raft_consensus.cc:2454] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459104120b9c41339f02cdc1b0a26563 in term 0.
I20260811 14:25:59.161029 26072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.156989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:34825 (local address 127.20.132.195:56269)
0811 14:25:59.157049 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.157062 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.157110 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.158489 (+ 1379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.158490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.158492 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:25:59.158543 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.158544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.159217 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.159218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.160037 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:25:59.160039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.160764 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.160765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:25:59.160839 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.160843 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.160907 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.160949 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 14:25:59.161098 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.157074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:56269 (local address 127.20.132.194:34825)
0811 14:25:59.157134 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.157137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.157170 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:25:59.157200 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.157201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.157212 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.158471 (+ 1259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:25:59.158651 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.159135 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.160118 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.160674 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.160752 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.160758 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.160969 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.161025 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 14:25:59.161329 25942 leader_election.cc:302] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459104120b9c41339f02cdc1b0a26563, ec0d0014be3c49ef99523d3edd5f5bad; no voters:
I20260811 14:25:59.161499 26094 raft_consensus.cc:2781] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:59.161581 26094 raft_consensus.cc:482] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:59.161607 26094 raft_consensus.cc:3037] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.161721 25865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07ed98bd6ad4a4b9d68b38ca58ed069" candidate_uuid: "459104120b9c41339f02cdc1b0a26563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" is_pre_election: true
I20260811 14:25:59.161878 25865 raft_consensus.cc:2454] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459104120b9c41339f02cdc1b0a26563 in term 0.
I20260811 14:25:59.162465 26094 raft_consensus.cc:504] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.162599 26094 leader_election.cc:288] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [CANDIDATE]: Term 1 election: Requested vote from peers f3b5db43bf3f4035b45516ffb22abe1c (127.20.132.194:34825), ec0d0014be3c49ef99523d3edd5f5bad (127.20.132.193:45721)
I20260811 14:25:59.162727 25865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07ed98bd6ad4a4b9d68b38ca58ed069" candidate_uuid: "459104120b9c41339f02cdc1b0a26563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3b5db43bf3f4035b45516ffb22abe1c"
I20260811 14:25:59.162771 25716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07ed98bd6ad4a4b9d68b38ca58ed069" candidate_uuid: "459104120b9c41339f02cdc1b0a26563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0d0014be3c49ef99523d3edd5f5bad"
I20260811 14:25:59.162818 25865 raft_consensus.cc:3037] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.162845 25716 raft_consensus.cc:3037] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.163764 25865 raft_consensus.cc:2454] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459104120b9c41339f02cdc1b0a26563 in term 1.
I20260811 14:25:59.163764 25716 raft_consensus.cc:2454] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459104120b9c41339f02cdc1b0a26563 in term 1.
I20260811 14:25:59.163944 25942 leader_election.cc:302] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459104120b9c41339f02cdc1b0a26563, ec0d0014be3c49ef99523d3edd5f5bad; no voters:
I20260811 14:25:59.164042 26094 raft_consensus.cc:2781] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:59.164244 26094 raft_consensus.cc:686] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 1 LEADER]: Becoming Leader. State: Replica: 459104120b9c41339f02cdc1b0a26563, State: Running, Role: LEADER
I20260811 14:25:59.164353 26094 consensus_queue.cc:237] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } }
I20260811 14:25:59.165287 25559 catalog_manager.cc:5495] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459104120b9c41339f02cdc1b0a26563 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "459104120b9c41339f02cdc1b0a26563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459104120b9c41339f02cdc1b0a26563" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43613 } health_report { overall_health: HEALTHY } } }
I20260811 14:25:59.179682 26086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.177224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48444 (local address 127.20.132.195:43613)
0811 14:25:59.177291 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.177293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.177303 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:59.177374 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.177375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.177393 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.177486 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:25:59.177628 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.178099 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.178875 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:25:59.179073 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:25:59.179147 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:25:59.179324 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:25:59.179444 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:25:59.179534 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.179552 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.179573 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 14:25:59.181639 25865 raft_consensus.cc:1261] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 1 FOLLOWER]: Refusing update from remote peer 459104120b9c41339f02cdc1b0a26563: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:59.181627 25716 raft_consensus.cc:1261] T d07ed98bd6ad4a4b9d68b38ca58ed069 P ec0d0014be3c49ef99523d3edd5f5bad [term 1 FOLLOWER]: Refusing update from remote peer 459104120b9c41339f02cdc1b0a26563: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:59.182037 26098 consensus_queue.cc:1035] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3b5db43bf3f4035b45516ffb22abe1c" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 34825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:59.182163 26094 consensus_queue.cc:1035] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec0d0014be3c49ef99523d3edd5f5bad" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:25:59.183871 25919 tablet.cc:2369] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:25:59.185194 26103 mvcc.cc:205] Tried to move back new op lower bound from 7317333439205015552 to 7317333439138127872. Current Snapshot: MvccSnapshot[applied={T|T < 7317333439205015552}]
I20260811 14:25:59.187918 25559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:59.188014 25559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:59.188822 25559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aeb76a4237cf478f8a0f69efec8fb856: Sending DeleteTablet for 3 replicas of tablet d07ed98bd6ad4a4b9d68b38ca58ed069
I20260811 14:25:59.189160 25844 tablet_service.cc:1514] Processing DeleteTablet for tablet d07ed98bd6ad4a4b9d68b38ca58ed069 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:59 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:33740
I20260811 14:25:59.189175 25695 tablet_service.cc:1514] Processing DeleteTablet for tablet d07ed98bd6ad4a4b9d68b38ca58ed069 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:59 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:48854
I20260811 14:25:59.189381 25995 tablet_service.cc:1514] Processing DeleteTablet for tablet d07ed98bd6ad4a4b9d68b38ca58ed069 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:59 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:48428
I20260811 14:25:59.189599 26113 tablet_replica.cc:330] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: stopping tablet replica
I20260811 14:25:59.189728 26113 raft_consensus.cc:2229] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:59.189854 26113 raft_consensus.cc:2258] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:59.189910 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25626
I20260811 14:25:59.195611 26113 ts_tablet_manager.cc:1905] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:59.197604 26113 ts_tablet_manager.cc:1918] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:25:59.197681 26113 log.cc:1196] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/d07ed98bd6ad4a4b9d68b38ca58ed069
I20260811 14:25:59.197916 26113 ts_tablet_manager.cc:1939] T d07ed98bd6ad4a4b9d68b38ca58ed069 P 459104120b9c41339f02cdc1b0a26563: Deleting consensus metadata
I20260811 14:25:59.201998 25544 catalog_manager.cc:4841] TS 459104120b9c41339f02cdc1b0a26563 (127.20.132.195:43613): tablet d07ed98bd6ad4a4b9d68b38ca58ed069 (table test-table [id=0b791e73bc574a4fa5c0927e8dfd9f77]) successfully deleted
I20260811 14:25:59.189841 26111 tablet_replica.cc:330] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: stopping tablet replica
I20260811 14:25:59.203699 26111 raft_consensus.cc:2229] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:25:59.203848 26111 raft_consensus.cc:2258] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:59.204388 26111 ts_tablet_manager.cc:1905] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:25:59.206081 26111 ts_tablet_manager.cc:1918] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:25:59.206162 26111 log.cc:1196] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/d07ed98bd6ad4a4b9d68b38ca58ed069
I20260811 14:25:59.206445 26111 ts_tablet_manager.cc:1939] T d07ed98bd6ad4a4b9d68b38ca58ed069 P f3b5db43bf3f4035b45516ffb22abe1c: Deleting consensus metadata
I20260811 14:25:59.206918 25543 catalog_manager.cc:4841] TS f3b5db43bf3f4035b45516ffb22abe1c (127.20.132.194:34825): tablet d07ed98bd6ad4a4b9d68b38ca58ed069 (table test-table [id=0b791e73bc574a4fa5c0927e8dfd9f77]) successfully deleted
W20260811 14:25:59.207551 25543 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:45721 (error 108)
I20260811 14:25:59.207875 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25776
I20260811 14:25:59.208806 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.207938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45721 (local address 127.0.0.1:48858)
0811 14:25:59.208720 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.208766 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":756}
W20260811 14:25:59.209407 25543 catalog_manager.cc:4584] TS ec0d0014be3c49ef99523d3edd5f5bad (127.20.132.193:45721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d07ed98bd6ad4a4b9d68b38ca58ed069: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45721: connect: Connection refused (error 111)
I20260811 14:25:59.214550 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25924
I20260811 14:25:59.221482 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 25524
2026-08-11T14:25:59Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1985 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T14:25:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:25:59Z Disabled control of system clock
I20260811 14:25:59.253245 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:40937
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:40937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:25:59.334636 26118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:59.334839 26118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:59.334860 26118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:59.335909 26118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:25:59.335943 26118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:59.335956 26118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:59.335969 26118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:25:59.335981 26118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:25:59.337348 26118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:40937
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:40937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:59.337543 26118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:59.337787 26118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:59.342409 26124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.342494 26127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.342424 26125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:59.342842 26118 server_base.cc:1034] running on GCE node
I20260811 14:25:59.343088 26118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:59.343354 26118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:59.344511 26118 hybrid_clock.cc:648] HybridClock initialized: now 1786458359344498 us; error 39 us; skew 500 ppm
I20260811 14:25:59.345964 26118 webserver.cc:460] Webserver started at http://127.20.132.254:39489/ using document root <none> and password file <none>
I20260811 14:25:59.346248 26118 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:59.346302 26118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:59.346493 26118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:59.347626 26118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "aa9e7012914f4d16875269b2f530a295"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "210571d4f3c0e503077d1810aa63e1a4"
server_key_iv: "2e9af04aea845afc01865c16722072f4"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.348026 26118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "aa9e7012914f4d16875269b2f530a295"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "210571d4f3c0e503077d1810aa63e1a4"
server_key_iv: "2e9af04aea845afc01865c16722072f4"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.349433 26118 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:25:59.350165 26133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.350332 26118 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:25:59.350435 26118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "aa9e7012914f4d16875269b2f530a295"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "210571d4f3c0e503077d1810aa63e1a4"
server_key_iv: "2e9af04aea845afc01865c16722072f4"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.350507 26118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:59.353900 26118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:59.354192 26118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:59.354334 26118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:59.358153 26118 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:40937
I20260811 14:25:59.358174 26191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:40937 every 8 connection(s)
I20260811 14:25:59.358500 26118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:25:59.359105 26192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.361927 26192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295: Bootstrap starting.
I20260811 14:25:59.362475 26192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.362769 26192 log.cc:824] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.363409 26192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295: No bootstrap required, opened a new log
I20260811 14:25:59.365006 26192 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9e7012914f4d16875269b2f530a295" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40937 } }
I20260811 14:25:59.365135 26192 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.365181 26192 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa9e7012914f4d16875269b2f530a295, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.365316 26192 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9e7012914f4d16875269b2f530a295" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40937 } }
I20260811 14:25:59.365375 26192 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:25:59.365396 26192 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:25:59.365460 26192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.365957 26192 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9e7012914f4d16875269b2f530a295" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40937 } }
I20260811 14:25:59.366065 26192 leader_election.cc:302] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa9e7012914f4d16875269b2f530a295; no voters:
I20260811 14:25:59.366267 26192 leader_election.cc:288] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:25:59.366412 26195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:59.366546 26192 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:25:59.366643 26195 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [term 1 LEADER]: Becoming Leader. State: Replica: aa9e7012914f4d16875269b2f530a295, State: Running, Role: LEADER
I20260811 14:25:59.366742 26195 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9e7012914f4d16875269b2f530a295" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40937 } }
I20260811 14:25:59.367161 26197 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa9e7012914f4d16875269b2f530a295. Latest consensus state: current_term: 1 leader_uuid: "aa9e7012914f4d16875269b2f530a295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9e7012914f4d16875269b2f530a295" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40937 } } }
I20260811 14:25:59.367255 26197 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:59.367377 26196 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa9e7012914f4d16875269b2f530a295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9e7012914f4d16875269b2f530a295" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40937 } } }
I20260811 14:25:59.367451 26196 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295 [sys.catalog]: This master's current role is: LEADER
I20260811 14:25:59.367779 26205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:25:59.367839 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26118
I20260811 14:25:59.367947 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:25:59.368161 21011 external_mini_cluster.cc:1428] Setting key 0b2f5bfed9eacf292d57323a8049cb8e
I20260811 14:25:59.368369 26205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:25:59.370319 26205 catalog_manager.cc:1347] Generated new cluster ID: d3f83f07ff824b9d908646848ee246b5
I20260811 14:25:59.370375 26205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:25:59.370530 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.368739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42996 (local address 127.20.132.254:40937)
0811 14:25:59.369069 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.369076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.369101 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:25:59.369183 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.369188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.369218 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.369501 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.370078 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.370082 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.370082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.370087 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.370128 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.370142 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.370178 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.370313 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.370368 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":74,"threads_started":1}
I20260811 14:25:59.392117 26205 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:25:59.392325 26205 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:25:59.396850 26205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295: Generated new TSK 0
I20260811 14:25:59.397027 26205 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:25:59.403801 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:40937
--builtin_ntp_servers=127.20.132.212:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:25:59.485769 26219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:59.485998 26219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:59.486034 26219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:59.487185 26219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:59.487243 26219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:59.487286 26219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:25:59.488735 26219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:40937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:59.489012 26219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:59.489327 26219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:59.494412 26225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.494460 26226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.494405 26228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:59.494530 26219 server_base.cc:1034] running on GCE node
I20260811 14:25:59.494832 26219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:59.495080 26219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:59.496213 26219 hybrid_clock.cc:648] HybridClock initialized: now 1786458359496193 us; error 29 us; skew 500 ppm
I20260811 14:25:59.497529 26219 webserver.cc:460] Webserver started at http://127.20.132.193:41455/ using document root <none> and password file <none>
I20260811 14:25:59.497782 26219 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:59.497831 26219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:59.498004 26219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:59.499068 26219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "0a6f7363bab742f9b8605cc3503aa858"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "18a37b3e3f8d3152d28839b1df69f3b4"
server_key_iv: "0f5cfbec8e5abe4b5ef4d5d5768d19ca"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.499460 26219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "0a6f7363bab742f9b8605cc3503aa858"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "18a37b3e3f8d3152d28839b1df69f3b4"
server_key_iv: "0f5cfbec8e5abe4b5ef4d5d5768d19ca"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.500841 26219 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:25:59.501659 26235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.501875 26219 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:59.501965 26219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "0a6f7363bab742f9b8605cc3503aa858"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "18a37b3e3f8d3152d28839b1df69f3b4"
server_key_iv: "0f5cfbec8e5abe4b5ef4d5d5768d19ca"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.502039 26219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:59.505578 26219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:59.505825 26219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:59.505954 26219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:59.506155 26219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:59.506465 26219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:59.506497 26219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.506549 26219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:59.506587 26219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.512337 26219 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:36581
I20260811 14:25:59.512418 26364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:36581 every 8 connection(s)
I20260811 14:25:59.512749 26219 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:25:59.515902 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.513501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:57673 (local address 127.20.132.254:40937)
0811 14:25:59.513568 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.513570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.513793 (+ 223us) server_negotiation.cc:407] Connection header received
0811 14:25:59.514330 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.514331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.514341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.514392 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.515631 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.515633 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.515633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.515637 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.515658 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.515667 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.515724 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.515818 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.515835 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:25:59.516104 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.513494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:40937 (local address 127.20.132.193:57673)
0811 14:25:59.513679 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.513710 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.514209 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.514457 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.514461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.514470 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.515461 (+ 991us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.515461 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.515489 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.515516 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.515738 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.515744 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.515747 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.515823 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.515884 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260811 14:25:59.516636 26365 heartbeater.cc:347] Connected to a master server at 127.20.132.254:40937
I20260811 14:25:59.516712 26365 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:59.516894 26365 heartbeater.cc:511] Master 127.20.132.254:40937 requested a full tablet report, sending...
I20260811 14:25:59.517396 26150 ts_manager.cc:194] Registered new tserver with Master: 0a6f7363bab742f9b8605cc3503aa858 (127.20.132.193:36581)
I20260811 14:25:59.519513 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26219
I20260811 14:25:59.519589 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:25:59.519794 21011 external_mini_cluster.cc:1428] Setting key 3289511415a71b78f8a2139bf543d99e
I20260811 14:25:59.520720 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:40937
--builtin_ntp_servers=127.20.132.212:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:25:59.602627 26368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:59.602818 26368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:59.602840 26368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:59.603996 26368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:59.604035 26368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:59.604061 26368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:25:59.605659 26368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:40937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:59.605880 26368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:59.606185 26368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:59.611035 26374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:59.611136 26368 server_base.cc:1034] running on GCE node
W20260811 14:25:59.611107 26373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.611050 26376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:59.611462 26368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:59.611737 26368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:59.612905 26368 hybrid_clock.cc:648] HybridClock initialized: now 1786458359612887 us; error 29 us; skew 500 ppm
I20260811 14:25:59.614091 26368 webserver.cc:460] Webserver started at http://127.20.132.194:39125/ using document root <none> and password file <none>
I20260811 14:25:59.614347 26368 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:59.614415 26368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:59.614568 26368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:59.615700 26368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "fac832e3506b482c8bbe773ca18b8c80"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "726e4f8228d49f14b3a5e25bc11d7bf0"
server_key_iv: "5963a64e07b171b993eb4ea67c48e109"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.616056 26368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "fac832e3506b482c8bbe773ca18b8c80"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "726e4f8228d49f14b3a5e25bc11d7bf0"
server_key_iv: "5963a64e07b171b993eb4ea67c48e109"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.617352 26368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:59.618073 26385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.618238 26368 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:59.618342 26368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "fac832e3506b482c8bbe773ca18b8c80"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "726e4f8228d49f14b3a5e25bc11d7bf0"
server_key_iv: "5963a64e07b171b993eb4ea67c48e109"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.618415 26368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:59.621757 26368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:59.622023 26368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:59.622174 26368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:59.622381 26368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:59.622685 26368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:59.622740 26368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.622777 26368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:59.622804 26368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.628806 26368 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:37513
I20260811 14:25:59.628852 26509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:37513 every 8 connection(s)
I20260811 14:25:59.629168 26368 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:25:59.632048 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.629853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:58501 (local address 127.20.132.254:40937)
0811 14:25:59.629939 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.629941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.630139 (+ 198us) server_negotiation.cc:407] Connection header received
0811 14:25:59.630585 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.630586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.630590 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.630652 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.631871 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.631872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.631872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.631875 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.631885 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.631888 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.631928 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.631985 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.631996 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:25:59.632294 26514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.629809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:40937 (local address 127.20.132.194:58501)
0811 14:25:59.630016 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.630050 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.630503 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.630701 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.630704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.630712 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.631741 (+ 1029us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.631742 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.631770 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.631799 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.631927 (+ 128us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.631929 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.631931 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.631982 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.632030 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":103,"threads_started":1}
I20260811 14:25:59.632807 26511 heartbeater.cc:347] Connected to a master server at 127.20.132.254:40937
I20260811 14:25:59.632912 26511 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:59.633069 26511 heartbeater.cc:511] Master 127.20.132.254:40937 requested a full tablet report, sending...
I20260811 14:25:59.633450 26150 ts_manager.cc:194] Registered new tserver with Master: fac832e3506b482c8bbe773ca18b8c80 (127.20.132.194:37513)
I20260811 14:25:59.635859 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26368
I20260811 14:25:59.635941 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:25:59.636191 21011 external_mini_cluster.cc:1428] Setting key 584465a802feb53e998fc871eb3751da
I20260811 14:25:59.637072 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:40937
--builtin_ntp_servers=127.20.132.212:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:25:59.719198 26515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:25:59.719434 26515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:25:59.719470 26515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:25:59.720659 26515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:25:59.720755 26515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:25:59.720822 26515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:25:59.722262 26515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:40937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:25:59.722519 26515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:25:59.722813 26515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:25:59.727790 26520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.727807 26522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:25:59.727787 26524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:25:59.728099 26515 server_base.cc:1034] running on GCE node
I20260811 14:25:59.728353 26515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:25:59.728549 26515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:25:59.729686 26515 hybrid_clock.cc:648] HybridClock initialized: now 1786458359729681 us; error 37 us; skew 500 ppm
I20260811 14:25:59.730906 26515 webserver.cc:460] Webserver started at http://127.20.132.195:44419/ using document root <none> and password file <none>
I20260811 14:25:59.731166 26515 fs_manager.cc:359] Metadata directory not provided
I20260811 14:25:59.731215 26515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:25:59.731364 26515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:25:59.732499 26515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "b9072173fe9b4170af5e91ddaec805f3"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "bafa7bc740091d83b59c2cfdc6113591"
server_key_iv: "247dbfb477362f75c89fbcb2935a8cb4"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.732843 26515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "b9072173fe9b4170af5e91ddaec805f3"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "bafa7bc740091d83b59c2cfdc6113591"
server_key_iv: "247dbfb477362f75c89fbcb2935a8cb4"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.734082 26515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:25:59.734800 26531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.734973 26515 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:25:59.735070 26515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "b9072173fe9b4170af5e91ddaec805f3"
format_stamp: "Formatted at 2026-08-11 14:25:59 on dist-test-slave-cbbz"
server_key: "bafa7bc740091d83b59c2cfdc6113591"
server_key_iv: "247dbfb477362f75c89fbcb2935a8cb4"
server_key_version: "encryptionkey@0"
I20260811 14:25:59.735155 26515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:25:59.738512 26515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:25:59.738762 26515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:25:59.738907 26515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:25:59.739112 26515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:25:59.739418 26515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:25:59.739472 26515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.739512 26515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:25:59.739539 26515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:25:59.745314 26515 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43453
I20260811 14:25:59.745360 26655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43453 every 8 connection(s)
I20260811 14:25:59.745661 26515 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:25:59.748633 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.746325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:33923 (local address 127.20.132.254:40937)
0811 14:25:59.746406 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.746409 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.746625 (+ 216us) server_negotiation.cc:407] Connection header received
0811 14:25:59.747123 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.747124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.747131 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.747195 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.748390 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.748392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.748392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.748396 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.748412 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.748416 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.748472 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.748549 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.748565 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:25:59.748819 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.746288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:40937 (local address 127.20.132.195:33923)
0811 14:25:59.746498 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.746529 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.747009 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.747262 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.747266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.747275 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.748241 (+ 966us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.748241 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.748268 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.748294 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.748474 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.748479 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.748482 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.748549 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.748616 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260811 14:25:59.749289 26656 heartbeater.cc:347] Connected to a master server at 127.20.132.254:40937
I20260811 14:25:59.749361 26656 heartbeater.cc:464] Registering TS with master...
I20260811 14:25:59.749526 26656 heartbeater.cc:511] Master 127.20.132.254:40937 requested a full tablet report, sending...
I20260811 14:25:59.749884 26150 ts_manager.cc:194] Registered new tserver with Master: b9072173fe9b4170af5e91ddaec805f3 (127.20.132.195:43453)
I20260811 14:25:59.752012 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26515
I20260811 14:25:59.752111 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:25:59.752295 21011 external_mini_cluster.cc:1428] Setting key 90d051ed6a2337a99fb606d7ec3b1fbb
I20260811 14:25:59.753127 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:25:59.755637 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.754425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42998 (local address 127.20.132.254:40937)
0811 14:25:59.754482 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.754484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.754616 (+ 132us) server_negotiation.cc:407] Connection header received
0811 14:25:59.754716 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.754717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.754722 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.754791 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.755425 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.755426 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.755426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.755430 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.755445 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.755449 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.755495 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.755550 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.755567 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:25:59.757339 26150 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:25:59.758888 26150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:25:59.762753 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.761262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43453 (local address 127.0.0.1:50256)
0811 14:25:59.761449 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.761459 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.761496 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.761853 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.761854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.761855 (+ 1us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.762336 (+ 481us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.762337 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.762356 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.762373 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.762594 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.762602 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.762605 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.762674 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.762689 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":63,"threads_started":1}
I20260811 14:25:59.762795 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.761432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50256 (local address 127.20.132.195:43453)
0811 14:25:59.761618 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.761621 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.761630 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:25:59.761653 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.761655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.761663 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.762042 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.762455 (+ 413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.762462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.762463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.762468 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.762502 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.762523 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.762582 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.762700 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.762716 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260811 14:25:59.762946 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.761170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47966 (local address 127.20.132.193:36581)
0811 14:25:59.761390 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.761393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.761438 (+ 45us) server_negotiation.cc:407] Connection header received
0811 14:25:59.761549 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.761553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.761563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.761610 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.762635 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.762642 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.762642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.762646 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.762677 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.762706 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.762762 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.762857 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.762871 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":86,"threads_started":1}
I20260811 14:25:59.762995 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.761106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54506 (local address 127.20.132.194:37513)
0811 14:25:59.761289 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.761293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.761303 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:25:59.761401 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.761407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.761419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.761479 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.762489 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.762499 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.762499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.762503 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.762536 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.762560 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.762617 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.762726 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.762744 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":74,"threads_started":1}
I20260811 14:25:59.763232 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.761027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37513 (local address 127.0.0.1:54506)
0811 14:25:59.761219 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.761255 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.761311 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.761836 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.761842 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.761848 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.762399 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.762400 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.762407 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.762420 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.762646 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.762647 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.762648 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.763127 (+ 479us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.763143 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":91,"threads_started":1}
I20260811 14:25:59.763239 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.761032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36581 (local address 127.0.0.1:47966)
0811 14:25:59.761362 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.761374 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.761466 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.761962 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.761963 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.761966 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.762551 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.762552 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.762557 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.762571 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.762786 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.762787 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.762787 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.763163 (+ 376us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.763175 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":86,"threads_started":1}
I20260811 14:25:59.763780 26586 tablet_service.cc:1467] Processing CreateTablet for tablet 444797a70be74a2a8afad5df2b93c297 (DEFAULT_TABLE table=test-table [id=7e9f09fedddc481c98178d710c010f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:59.764165 26586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444797a70be74a2a8afad5df2b93c297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.764092 26438 tablet_service.cc:1467] Processing CreateTablet for tablet 444797a70be74a2a8afad5df2b93c297 (DEFAULT_TABLE table=test-table [id=7e9f09fedddc481c98178d710c010f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:59.764171 26286 tablet_service.cc:1467] Processing CreateTablet for tablet 444797a70be74a2a8afad5df2b93c297 (DEFAULT_TABLE table=test-table [id=7e9f09fedddc481c98178d710c010f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:25:59.764468 26438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444797a70be74a2a8afad5df2b93c297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.764520 26286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444797a70be74a2a8afad5df2b93c297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:25:59.767117 26675 tablet_bootstrap.cc:492] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: Bootstrap starting.
I20260811 14:25:59.767731 26676 tablet_bootstrap.cc:492] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Bootstrap starting.
I20260811 14:25:59.767899 26675 tablet_bootstrap.cc:654] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.768230 26677 tablet_bootstrap.cc:492] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Bootstrap starting.
I20260811 14:25:59.768303 26675 log.cc:824] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.768410 26676 tablet_bootstrap.cc:654] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.768709 26676 log.cc:824] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.768868 26677 tablet_bootstrap.cc:654] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Neither blocks nor log segments found. Creating new log.
I20260811 14:25:59.769155 26675 tablet_bootstrap.cc:492] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: No bootstrap required, opened a new log
I20260811 14:25:59.769223 26675 ts_tablet_manager.cc:1397] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:25:59.769222 26677 log.cc:824] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Log is configured to *not* fsync() on all Append() calls
I20260811 14:25:59.769484 26676 tablet_bootstrap.cc:492] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: No bootstrap required, opened a new log
I20260811 14:25:59.769575 26676 ts_tablet_manager.cc:1397] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:25:59.770108 26677 tablet_bootstrap.cc:492] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: No bootstrap required, opened a new log
I20260811 14:25:59.770165 26677 ts_tablet_manager.cc:1397] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:25:59.771265 26675 raft_consensus.cc:348] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.771377 26675 raft_consensus.cc:374] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.771396 26675 raft_consensus.cc:729] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6f7363bab742f9b8605cc3503aa858, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.771509 26675 consensus_queue.cc:260] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.771778 26365 heartbeater.cc:503] Master 127.20.132.254:40937 was elected leader, sending a full tablet report...
I20260811 14:25:59.771989 26675 ts_tablet_manager.cc:1428] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:25:59.772253 26676 raft_consensus.cc:348] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.772430 26676 raft_consensus.cc:374] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.772468 26676 raft_consensus.cc:729] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac832e3506b482c8bbe773ca18b8c80, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.772575 26676 consensus_queue.cc:260] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.772837 26511 heartbeater.cc:503] Master 127.20.132.254:40937 was elected leader, sending a full tablet report...
I20260811 14:25:59.772811 26677 raft_consensus.cc:348] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.772979 26677 raft_consensus.cc:374] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:25:59.773015 26677 raft_consensus.cc:729] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9072173fe9b4170af5e91ddaec805f3, State: Initialized, Role: FOLLOWER
I20260811 14:25:59.773144 26677 consensus_queue.cc:260] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.773311 26676 ts_tablet_manager.cc:1428] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260811 14:25:59.773416 26677 ts_tablet_manager.cc:1428] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:25:59.773511 26656 heartbeater.cc:503] Master 127.20.132.254:40937 was elected leader, sending a full tablet report...
W20260811 14:25:59.879714 26512 tablet.cc:2369] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:25:59.940569 26681 raft_consensus.cc:482] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:25:59.940707 26681 raft_consensus.cc:504] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.941095 26681 leader_election.cc:288] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fac832e3506b482c8bbe773ca18b8c80 (127.20.132.194:37513), b9072173fe9b4170af5e91ddaec805f3 (127.20.132.195:43453)
I20260811 14:25:59.942760 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.941373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37513 (local address 127.20.132.193:58145)
0811 14:25:59.941441 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.941457 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.941523 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.941785 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.941787 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.941790 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.942431 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.942432 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.942438 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.942450 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.942630 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.942630 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.942631 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.942678 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.942692 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 14:25:59.942762 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.941459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:58145 (local address 127.20.132.194:37513)
0811 14:25:59.941624 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.941626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.941651 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:25:59.941684 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.941685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.941689 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.941752 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.942536 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.942537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.942537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.942542 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.942563 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.942567 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.942645 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.942686 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.942700 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260811 14:25:59.943094 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.941500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43453 (local address 127.20.132.193:35987)
0811 14:25:59.941672 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 14:25:59.941683 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:25:59.941761 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:25:59.942004 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:25:59.942004 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:25:59.942007 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:25:59.942661 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:25:59.942661 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:25:59.942673 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:25:59.942685 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:25:59.942919 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:25:59.942920 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:25:59.942920 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 14:25:59.943005 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 14:25:59.943018 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
I20260811 14:25:59.943100 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.941597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:35987 (local address 127.20.132.195:43453)
0811 14:25:59.941639 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.941641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.941736 (+ 95us) server_negotiation.cc:407] Connection header received
0811 14:25:59.941893 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.941894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.941900 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.941964 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.942776 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.942778 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.942778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.942783 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.942823 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.942829 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.942888 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.943014 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.943031 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:25:59.943120 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444797a70be74a2a8afad5df2b93c297" candidate_uuid: "0a6f7363bab742f9b8605cc3503aa858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac832e3506b482c8bbe773ca18b8c80" is_pre_election: true
I20260811 14:25:59.943321 26459 raft_consensus.cc:2454] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6f7363bab742f9b8605cc3503aa858 in term 0.
I20260811 14:25:59.943487 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444797a70be74a2a8afad5df2b93c297" candidate_uuid: "0a6f7363bab742f9b8605cc3503aa858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9072173fe9b4170af5e91ddaec805f3" is_pre_election: true
I20260811 14:25:59.943552 26238 leader_election.cc:302] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6f7363bab742f9b8605cc3503aa858, fac832e3506b482c8bbe773ca18b8c80; no voters:
I20260811 14:25:59.943648 26608 raft_consensus.cc:2454] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6f7363bab742f9b8605cc3503aa858 in term 0.
I20260811 14:25:59.943770 26681 raft_consensus.cc:2781] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:25:59.943841 26681 raft_consensus.cc:482] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:25:59.943869 26681 raft_consensus.cc:3037] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.944722 26681 raft_consensus.cc:504] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.944854 26681 leader_election.cc:288] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [CANDIDATE]: Term 1 election: Requested vote from peers fac832e3506b482c8bbe773ca18b8c80 (127.20.132.194:37513), b9072173fe9b4170af5e91ddaec805f3 (127.20.132.195:43453)
I20260811 14:25:59.945044 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444797a70be74a2a8afad5df2b93c297" candidate_uuid: "0a6f7363bab742f9b8605cc3503aa858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9072173fe9b4170af5e91ddaec805f3"
I20260811 14:25:59.945040 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444797a70be74a2a8afad5df2b93c297" candidate_uuid: "0a6f7363bab742f9b8605cc3503aa858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac832e3506b482c8bbe773ca18b8c80"
I20260811 14:25:59.945107 26608 raft_consensus.cc:3037] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.945118 26459 raft_consensus.cc:3037] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:25:59.945866 26459 raft_consensus.cc:2454] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6f7363bab742f9b8605cc3503aa858 in term 1.
I20260811 14:25:59.945896 26608 raft_consensus.cc:2454] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6f7363bab742f9b8605cc3503aa858 in term 1.
I20260811 14:25:59.946066 26238 leader_election.cc:302] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6f7363bab742f9b8605cc3503aa858, b9072173fe9b4170af5e91ddaec805f3; no voters:
I20260811 14:25:59.946201 26681 raft_consensus.cc:2781] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:25:59.946385 26681 raft_consensus.cc:686] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 1 LEADER]: Becoming Leader. State: Replica: 0a6f7363bab742f9b8605cc3503aa858, State: Running, Role: LEADER
I20260811 14:25:59.946507 26681 consensus_queue.cc:237] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } }
I20260811 14:25:59.947358 26149 catalog_manager.cc:5495] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6f7363bab742f9b8605cc3503aa858 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "0a6f7363bab742f9b8605cc3503aa858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6f7363bab742f9b8605cc3503aa858" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 } health_report { overall_health: UNKNOWN } } }
I20260811 14:25:59.989804 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:25:59.988898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47976 (local address 127.20.132.193:36581)
0811 14:25:59.988959 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 14:25:59.988965 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:25:59.988989 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:25:59.989026 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:25:59.989027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:25:59.989041 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:25:59.989085 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:25:59.989620 (+ 535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:25:59.989621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:25:59.989621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:25:59.989626 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:25:59.989642 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:25:59.989646 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:25:59.989694 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:25:59.989738 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 14:25:59.989750 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:25:59.991662 26608 raft_consensus.cc:1261] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 1 FOLLOWER]: Refusing update from remote peer 0a6f7363bab742f9b8605cc3503aa858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:59.991662 26459 raft_consensus.cc:1261] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 1 FOLLOWER]: Refusing update from remote peer 0a6f7363bab742f9b8605cc3503aa858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:25:59.992046 26686 consensus_queue.cc:1035] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac832e3506b482c8bbe773ca18b8c80" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:59.992223 26681 consensus_queue.cc:1035] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9072173fe9b4170af5e91ddaec805f3" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:25:59.994616 26691 mvcc.cc:205] Tried to move back new op lower bound from 7317333442522972160 to 7317333442341531648. Current Snapshot: MvccSnapshot[applied={T|T < 7317333442522972160}]
I20260811 14:25:59.994910 26692 mvcc.cc:205] Tried to move back new op lower bound from 7317333442522972160 to 7317333442341531648. Current Snapshot: MvccSnapshot[applied={T|T < 7317333442522972160}]
I20260811 14:25:59.997571 26149 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:59.997668 26149 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:25:59.998450 26149 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa9e7012914f4d16875269b2f530a295: Sending DeleteTablet for 3 replicas of tablet 444797a70be74a2a8afad5df2b93c297
I20260811 14:25:59.998787 26286 tablet_service.cc:1514] Processing DeleteTablet for tablet 444797a70be74a2a8afad5df2b93c297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:59 UTC) from {username='slave'} at 127.0.0.1:47966
I20260811 14:25:59.998869 26438 tablet_service.cc:1514] Processing DeleteTablet for tablet 444797a70be74a2a8afad5df2b93c297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:59 UTC) from {username='slave'} at 127.0.0.1:54506
I20260811 14:25:59.999001 26700 tablet_replica.cc:330] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858: stopping tablet replica
I20260811 14:25:59.999086 26586 tablet_service.cc:1514] Processing DeleteTablet for tablet 444797a70be74a2a8afad5df2b93c297 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:25:59 UTC) from {username='slave'} at 127.0.0.1:50256
I20260811 14:25:59.999130 26700 raft_consensus.cc:2229] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:25:59.999260 26700 raft_consensus.cc:2258] T 444797a70be74a2a8afad5df2b93c297 P 0a6f7363bab742f9b8605cc3503aa858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:25:59.999349 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26219
I20260811 14:25:59.999413 26701 tablet_replica.cc:330] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: stopping tablet replica
I20260811 14:25:59.999502 26701 raft_consensus.cc:2229] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:00.000643 26703 tablet_replica.cc:330] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: stopping tablet replica
I20260811 14:26:00.000732 26703 raft_consensus.cc:2229] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:00.000838 26703 raft_consensus.cc:2258] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:00.000965 26701 raft_consensus.cc:2258] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:00.001864 26703 ts_tablet_manager.cc:1905] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:00.003188 26701 ts_tablet_manager.cc:1905] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:00.003396 26703 ts_tablet_manager.cc:1918] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:00.003456 26703 log.cc:1196] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/444797a70be74a2a8afad5df2b93c297
I20260811 14:26:00.003708 26703 ts_tablet_manager.cc:1939] T 444797a70be74a2a8afad5df2b93c297 P b9072173fe9b4170af5e91ddaec805f3: Deleting consensus metadata
I20260811 14:26:00.004098 26136 catalog_manager.cc:4841] TS b9072173fe9b4170af5e91ddaec805f3 (127.20.132.195:43453): tablet 444797a70be74a2a8afad5df2b93c297 (table test-table [id=7e9f09fedddc481c98178d710c010f6c]) successfully deleted
I20260811 14:26:00.004923 26701 ts_tablet_manager.cc:1918] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:00.005036 26701 log.cc:1196] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/444797a70be74a2a8afad5df2b93c297
I20260811 14:26:00.005348 26701 ts_tablet_manager.cc:1939] T 444797a70be74a2a8afad5df2b93c297 P fac832e3506b482c8bbe773ca18b8c80: Deleting consensus metadata
I20260811 14:26:00.005786 26136 catalog_manager.cc:4841] TS fac832e3506b482c8bbe773ca18b8c80 (127.20.132.194:37513): tablet 444797a70be74a2a8afad5df2b93c297 (table test-table [id=7e9f09fedddc481c98178d710c010f6c]) successfully deleted
W20260811 14:26:00.009691 26134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:36581 (error 108)
I20260811 14:26:00.009977 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26368
I20260811 14:26:00.010176 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.010051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36581 (local address 127.0.0.1:47992)
0811 14:26:00.010104 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:00.010140 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:36581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 14:26:00.011482 26134 catalog_manager.cc:4584] TS 0a6f7363bab742f9b8605cc3503aa858 (127.20.132.193:36581): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 444797a70be74a2a8afad5df2b93c297: Network error: Client connection negotiation failed: client connection to 127.20.132.193:36581: connect: Connection refused (error 111)
I20260811 14:26:00.016981 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26515
I20260811 14:26:00.024084 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26118
2026-08-11T14:26:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (800 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 14:26:00.045672 21011 mini_oidc.cc:152] Starting JWKS server
I20260811 14:26:00.046912 21011 webserver.cc:460] Webserver started at https://127.0.0.1:46149/ using document root <none> and password file <none>
I20260811 14:26:00.046993 21011 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 14:26:00.047190 21011 webserver.cc:460] Webserver started at http://127.0.0.1:46315/ using document root <none> and password file <none>
2026-08-11T14:26:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:00Z Disabled control of system clock
I20260811 14:26:00.055743 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:43435
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:46001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:43435
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46149/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/testchainca.cert with env {}
W20260811 14:26:00.135953 26711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:00.136229 26711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:00.136279 26711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:00.137491 26711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:00.137532 26711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:00.137544 26711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:00.137557 26711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:00.137569 26711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:26:00.137624 26711 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:26:00.137640 26711 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46149/jwks.json
I20260811 14:26:00.139181 26711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:43435
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:43435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46149/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:00.139433 26711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:00.139600 26711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:00.144421 26719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:00.144402 26716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:00.144629 26711 server_base.cc:1034] running on GCE node
W20260811 14:26:00.144369 26717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:00.145761 26711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:00.146096 26711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:00.147266 26711 hybrid_clock.cc:648] HybridClock initialized: now 1786458360147252 us; error 47 us; skew 500 ppm
I20260811 14:26:00.148675 26711 webserver.cc:460] Webserver started at http://127.20.132.254:42299/ using document root <none> and password file <none>
I20260811 14:26:00.148914 26711 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:00.148984 26711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:00.149142 26711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:00.150192 26711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "9898b0e936bc410db492c7c9a818ffa0"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "b13cbc9b8113ccafdc05dc5cc89e9401"
server_key_iv: "2ec524d3235af96df82728c69340776d"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.150555 26711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "9898b0e936bc410db492c7c9a818ffa0"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "b13cbc9b8113ccafdc05dc5cc89e9401"
server_key_iv: "2ec524d3235af96df82728c69340776d"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.151844 26711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:00.152697 26728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:00.152876 26711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:26:00.152973 26711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "9898b0e936bc410db492c7c9a818ffa0"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "b13cbc9b8113ccafdc05dc5cc89e9401"
server_key_iv: "2ec524d3235af96df82728c69340776d"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.153060 26711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:00.182452 26711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:00.182821 26711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:00.182988 26711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:00.186980 26711 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:43435
I20260811 14:26:00.187019 26786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:43435 every 8 connection(s)
I20260811 14:26:00.187376 26711 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:00.188483 26788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:00.190253 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26711
I20260811 14:26:00.190361 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:00.190559 21011 external_mini_cluster.cc:1428] Setting key 9b1696b1ab39e685f62ff676e2b4be2b
I20260811 14:26:00.191279 26788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0: Bootstrap starting.
I20260811 14:26:00.192013 26788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:00.192556 26788 log.cc:824] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:00.193404 26788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0: No bootstrap required, opened a new log
I20260811 14:26:00.196394 26788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9898b0e936bc410db492c7c9a818ffa0" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43435 } }
I20260811 14:26:00.196588 26788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:00.196632 26788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9898b0e936bc410db492c7c9a818ffa0, State: Initialized, Role: FOLLOWER
I20260811 14:26:00.196774 26788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9898b0e936bc410db492c7c9a818ffa0" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43435 } }
I20260811 14:26:00.196869 26788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:00.196904 26788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:00.196949 26788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:00.197724 26788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9898b0e936bc410db492c7c9a818ffa0" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43435 } }
I20260811 14:26:00.197774 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.191101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.20.132.254:43435)
0811 14:26:00.191343 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.191352 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.191390 (+ 38us) server_negotiation.cc:407] Connection header received
0811 14:26:00.191984 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.191994 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.192086 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.192399 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:00.192607 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.194073 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.195154 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.195728 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.195847 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.196944 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:00.196948 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:00.196948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:00.197270 (+ 322us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:00.197330 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:00.197344 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:00.197422 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:00.197498 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 14:26:00.197583 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
I20260811 14:26:00.197891 26788 leader_election.cc:302] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9898b0e936bc410db492c7c9a818ffa0; no voters:
I20260811 14:26:00.198079 26788 leader_election.cc:288] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:00.198120 26794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:00.198235 26794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [term 1 LEADER]: Becoming Leader. State: Replica: 9898b0e936bc410db492c7c9a818ffa0, State: Running, Role: LEADER
I20260811 14:26:00.198314 26794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9898b0e936bc410db492c7c9a818ffa0" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43435 } }
I20260811 14:26:00.198374 26788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:00.198668 26794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9898b0e936bc410db492c7c9a818ffa0. Latest consensus state: current_term: 1 leader_uuid: "9898b0e936bc410db492c7c9a818ffa0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9898b0e936bc410db492c7c9a818ffa0" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43435 } } }
I20260811 14:26:00.198724 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:26:00.198746 26794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.199708 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9898b0e936bc410db492c7c9a818ffa0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9898b0e936bc410db492c7c9a818ffa0" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43435 } } }
I20260811 14:26:00.199795 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.200047 26798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:00.200613 26798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:00.202128 26798 catalog_manager.cc:1347] Generated new cluster ID: 4669685d03b24ad8a9d8a5b2a10d3a32
I20260811 14:26:00.202191 26798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:00.224681 26798 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:00.225234 26798 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:00.232112 26798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9898b0e936bc410db492c7c9a818ffa0: Generated new TSK 0
I20260811 14:26:00.232352 26798 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 14:26:00.257159 26826 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 14:26:00.257339 26826 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 14:26:00.257541 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.241987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.20.132.254:43435)
0811 14:26:00.242035 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.242037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.242182 (+ 145us) server_negotiation.cc:407] Connection header received
0811 14:26:00.242286 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.242287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.242298 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.242357 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:26:00.242514 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.242992 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.244081 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.244335 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.244392 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.244627 (+ 235us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:26:00.257269 (+ 12642us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 14:26:00.257458 (+ 189us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58268: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 14:26:00.257613 26791 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58268: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 14:26:00.258109 26825 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:00.241887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43435 (local address 127.0.0.1:58268)
0811 14:26:00.242105 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:00.242117 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:00.242191 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:00.242366 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:00.242367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:00.242368 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:26:00.242449 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.242452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.243089 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.243090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.243994 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.243998 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.244419 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.244420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.244486 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.244508 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:26:00.257551 (+ 13043us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 14:26:00.257695 (+ 144us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.132.254:43435: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":97,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.132.254:43435: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 14:26:00.258611 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26711
2026-08-11T14:26:00Z chronyd exiting
I20260811 14:26:00.296619 21011 test_util.cc:175] -----------------------------------------------
I20260811 14:26:00.296720 21011 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786458335845753-21011-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (252 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 14:26:00.297494 21011 mini_oidc.cc:152] Starting JWKS server
I20260811 14:26:00.298198 21011 webserver.cc:460] Webserver started at https://127.0.0.1:35525/ using document root <none> and password file <none>
I20260811 14:26:00.298264 21011 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 14:26:00.298452 21011 webserver.cc:460] Webserver started at http://127.0.0.1:36445/ using document root <none> and password file <none>
2026-08-11T14:26:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:00Z Disabled control of system clock
I20260811 14:26:00.306641 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:35907
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:39869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:35907
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35525/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/testchainca.cert with env {}
W20260811 14:26:00.386562 26832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:00.386773 26832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:00.386794 26832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:00.387955 26832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:00.387995 26832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:00.388007 26832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:00.388020 26832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:00.388082 26832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:26:00.388099 26832 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:26:00.388123 26832 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35525/jwks.json
I20260811 14:26:00.389659 26832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:35907
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:35907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35525/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:00.389916 26832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:00.390146 26832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:00.394861 26838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:00.394924 26839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:00.394891 26841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:00.395198 26832 server_base.cc:1034] running on GCE node
I20260811 14:26:00.395447 26832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:00.395740 26832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:00.396901 26832 hybrid_clock.cc:648] HybridClock initialized: now 1786458360396889 us; error 45 us; skew 500 ppm
I20260811 14:26:00.398151 26832 webserver.cc:460] Webserver started at http://127.20.132.254:44187/ using document root <none> and password file <none>
I20260811 14:26:00.398394 26832 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:00.398465 26832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:00.398618 26832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:00.399701 26832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "b2a37d47df7b407f8b21e792f37d8c32"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "7f20f050a143c3f243ec384b3e0dfd87"
server_key_iv: "ef42afa50fb06ac04c9dcfcc1285d3e3"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.400066 26832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "b2a37d47df7b407f8b21e792f37d8c32"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "7f20f050a143c3f243ec384b3e0dfd87"
server_key_iv: "ef42afa50fb06ac04c9dcfcc1285d3e3"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.401422 26832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:00.402160 26847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:00.402345 26832 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:00.402449 26832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "b2a37d47df7b407f8b21e792f37d8c32"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "7f20f050a143c3f243ec384b3e0dfd87"
server_key_iv: "ef42afa50fb06ac04c9dcfcc1285d3e3"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.402540 26832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:00.436769 26832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:00.437170 26832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:00.437338 26832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:00.441351 26832 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:35907
I20260811 14:26:00.441411 26906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:35907 every 8 connection(s)
I20260811 14:26:00.441779 26832 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:00.442500 26907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:00.445353 26907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32: Bootstrap starting.
I20260811 14:26:00.445888 26907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:00.446131 26907 log.cc:824] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:00.446791 26907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32: No bootstrap required, opened a new log
I20260811 14:26:00.448385 26907 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a37d47df7b407f8b21e792f37d8c32" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35907 } }
I20260811 14:26:00.448516 26907 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:00.448539 26907 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2a37d47df7b407f8b21e792f37d8c32, State: Initialized, Role: FOLLOWER
I20260811 14:26:00.448678 26907 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a37d47df7b407f8b21e792f37d8c32" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35907 } }
I20260811 14:26:00.448758 26907 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:00.448782 26907 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:00.448809 26907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:00.449280 26907 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a37d47df7b407f8b21e792f37d8c32" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35907 } }
I20260811 14:26:00.449360 26907 leader_election.cc:302] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2a37d47df7b407f8b21e792f37d8c32; no voters:
I20260811 14:26:00.449486 26907 leader_election.cc:288] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:00.449563 26912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:00.449731 26912 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [term 1 LEADER]: Becoming Leader. State: Replica: b2a37d47df7b407f8b21e792f37d8c32, State: Running, Role: LEADER
I20260811 14:26:00.449780 26907 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:00.449831 26912 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a37d47df7b407f8b21e792f37d8c32" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35907 } }
I20260811 14:26:00.450204 26913 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2a37d47df7b407f8b21e792f37d8c32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a37d47df7b407f8b21e792f37d8c32" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35907 } } }
I20260811 14:26:00.450299 26913 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.450397 26914 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2a37d47df7b407f8b21e792f37d8c32. Latest consensus state: current_term: 1 leader_uuid: "b2a37d47df7b407f8b21e792f37d8c32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a37d47df7b407f8b21e792f37d8c32" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35907 } } }
I20260811 14:26:00.450472 26914 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.450551 26922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:00.451051 26922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:00.451174 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26832
I20260811 14:26:00.451292 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:00.451493 21011 external_mini_cluster.cc:1428] Setting key 550ada7a8b69e9d869c612611427d7ad
I20260811 14:26:00.452934 26922 catalog_manager.cc:1347] Generated new cluster ID: d0902b0eb3a843899792ade4fa6abb24
I20260811 14:26:00.452996 26922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:00.457815 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.452200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.20.132.254:35907)
0811 14:26:00.452421 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.452429 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.452462 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:26:00.452570 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.452578 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.452662 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.452799 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:00.453091 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.454485 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.455534 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.456207 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.456330 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.457076 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:00.457080 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:00.457080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:00.457296 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:00.457340 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:00.457355 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:00.457425 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:00.457493 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 14:26:00.457568 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":81,"threads_started":1}
I20260811 14:26:00.458886 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:26:00.468344 26922 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:00.468874 26922 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:00.471879 26922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2a37d47df7b407f8b21e792f37d8c32: Generated new TSK 0
I20260811 14:26:00.472059 26922 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 14:26:00.496907 26944 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 14:26:00.496999 26944 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 14:26:00.497325 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.483123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.20.132.254:35907)
0811 14:26:00.483169 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.483171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.483269 (+ 98us) server_negotiation.cc:407] Connection header received
0811 14:26:00.483322 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.483323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.483336 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.483431 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:26:00.483514 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.484342 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.485076 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.485402 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.485474 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.485634 (+ 160us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:26:00.497098 (+ 11464us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35525/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 14:26:00.497252 (+ 154us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55778: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35525/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 14:26:00.497385 26936 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55778: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35525/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 14:26:00.497407 26943 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:00.483048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35907 (local address 127.0.0.1:55778)
0811 14:26:00.483187 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:00.483197 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:00.483268 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:00.483420 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:00.483421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:00.483422 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:26:00.483473 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.483475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.484415 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.484415 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.484994 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.484996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.485482 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.485483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.485524 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.485529 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:26:00.497215 (+ 11686us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35525/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 14:26:00.497311 (+ 96us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.132.254:35907: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35525/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260811 14:26:00.497742 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26832
2026-08-11T14:26:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (244 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 14:26:00.541687 21011 mini_oidc.cc:152] Starting JWKS server
I20260811 14:26:00.542426 21011 webserver.cc:460] Webserver started at https://127.0.0.1:44073/ using document root <none> and password file <none>
I20260811 14:26:00.542498 21011 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 14:26:00.542690 21011 webserver.cc:460] Webserver started at http://127.0.0.1:38075/ using document root <none> and password file <none>
2026-08-11T14:26:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:00Z Disabled control of system clock
I20260811 14:26:00.551568 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:40083
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:44975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:40083
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44073/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 14:26:00.633430 26950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:00.633630 26950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:00.633651 26950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:00.634763 26950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:00.634799 26950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:00.634812 26950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:00.634825 26950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:00.634837 26950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:26:00.634850 26950 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:26:00.634861 26950 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44073/jwks.json
I20260811 14:26:00.636183 26950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:40083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:40083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44073/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:00.636361 26950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:00.636600 26950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:00.642174 26959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:00.642068 26957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:00.642066 26955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:00.643046 26950 server_base.cc:1034] running on GCE node
I20260811 14:26:00.643349 26950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:00.643688 26950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:00.644860 26950 hybrid_clock.cc:648] HybridClock initialized: now 1786458360644837 us; error 42 us; skew 500 ppm
I20260811 14:26:00.646442 26950 webserver.cc:460] Webserver started at http://127.20.132.254:44759/ using document root <none> and password file <none>
I20260811 14:26:00.646720 26950 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:00.646793 26950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:00.646942 26950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:00.648439 26950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "54496407463a49d6aea3fdd1f8f20df1"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "d97af5804f59b2c5562acda0f418ea4a"
server_key_iv: "89fea4420198bb600471427c35cf7014"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.648905 26950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "54496407463a49d6aea3fdd1f8f20df1"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "d97af5804f59b2c5562acda0f418ea4a"
server_key_iv: "89fea4420198bb600471427c35cf7014"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.650447 26950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:26:00.651245 26967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:00.651425 26950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:00.651528 26950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "54496407463a49d6aea3fdd1f8f20df1"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "d97af5804f59b2c5562acda0f418ea4a"
server_key_iv: "89fea4420198bb600471427c35cf7014"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.651615 26950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:00.673027 26950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:00.673368 26950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:00.673528 26950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:00.677639 26950 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:40083
I20260811 14:26:00.677667 27026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:40083 every 8 connection(s)
I20260811 14:26:00.678016 26950 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:00.678684 27027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:00.681504 27027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1: Bootstrap starting.
I20260811 14:26:00.682093 27027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:00.682382 27027 log.cc:824] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:00.683050 27027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1: No bootstrap required, opened a new log
I20260811 14:26:00.684638 27027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54496407463a49d6aea3fdd1f8f20df1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40083 } }
I20260811 14:26:00.684772 27027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:00.684793 27027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54496407463a49d6aea3fdd1f8f20df1, State: Initialized, Role: FOLLOWER
I20260811 14:26:00.684962 27027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54496407463a49d6aea3fdd1f8f20df1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40083 } }
I20260811 14:26:00.685022 27027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:00.685062 27027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:00.685114 27027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:00.685657 27027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54496407463a49d6aea3fdd1f8f20df1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40083 } }
I20260811 14:26:00.685767 27027 leader_election.cc:302] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54496407463a49d6aea3fdd1f8f20df1; no voters:
I20260811 14:26:00.685953 27027 leader_election.cc:288] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:00.685953 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 26950
I20260811 14:26:00.685999 27032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:00.686055 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:00.686152 27032 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [term 1 LEADER]: Becoming Leader. State: Replica: 54496407463a49d6aea3fdd1f8f20df1, State: Running, Role: LEADER
I20260811 14:26:00.686215 27027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:00.686261 27032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54496407463a49d6aea3fdd1f8f20df1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40083 } }
I20260811 14:26:00.686291 21011 external_mini_cluster.cc:1428] Setting key f350dfaa657398ef7c00e78ade32c060
I20260811 14:26:00.686607 27032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54496407463a49d6aea3fdd1f8f20df1. Latest consensus state: current_term: 1 leader_uuid: "54496407463a49d6aea3fdd1f8f20df1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54496407463a49d6aea3fdd1f8f20df1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40083 } } }
I20260811 14:26:00.686730 27032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.686609 27033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54496407463a49d6aea3fdd1f8f20df1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54496407463a49d6aea3fdd1f8f20df1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 40083 } } }
I20260811 14:26:00.686903 27033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.687834 27041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:00.688455 27041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:00.690171 27041 catalog_manager.cc:1347] Generated new cluster ID: b0e9704b04d9457ebd4a2964f6cdd93f
I20260811 14:26:00.690231 27041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:00.692301 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.686935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35958 (local address 127.20.132.254:40083)
0811 14:26:00.687150 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.687159 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.687245 (+ 86us) server_negotiation.cc:407] Connection header received
0811 14:26:00.687404 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.687412 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.687485 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.687629 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:00.687915 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.689006 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.690014 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.690677 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.690799 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.691563 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:00.691567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:00.691567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:00.691782 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:00.691822 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:00.691836 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:00.691897 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:00.692004 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 14:26:00.692079 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":113,"threads_started":1}
I20260811 14:26:00.693260 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:26:00.703032 27041 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:00.703715 27041 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:00.709237 27041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54496407463a49d6aea3fdd1f8f20df1: Generated new TSK 0
I20260811 14:26:00.709429 27041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:26:00.721684 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.718136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35972 (local address 127.20.132.254:40083)
0811 14:26:00.718188 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.718191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.718292 (+ 101us) server_negotiation.cc:407] Connection header received
0811 14:26:00.718389 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.718390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.718401 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.718473 (+ 72us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:26:00.718626 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.719155 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.719958 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.720254 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.720327 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.720519 (+ 192us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:26:00.721468 (+ 949us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44073/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 14:26:00.721614 (+ 146us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35972: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44073/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 14:26:00.721742 27044 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35972: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44073/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 14:26:00.721823 27060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:00.718038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:40083 (local address 127.0.0.1:35972)
0811 14:26:00.718207 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:00.718222 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:00.718306 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:00.718478 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:00.718478 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:00.718480 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:26:00.718546 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.718549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.719248 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.719249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.719861 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.719864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.720348 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.720350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.720411 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.720416 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:26:00.721577 (+ 1161us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44073/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 14:26:00.721695 (+ 118us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.132.254:40083: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44073/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260811 14:26:00.721995 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 26950
E20260811 14:26:00.734324 27061 webserver.cc:533] Webserver: sslize failed:
E20260811 14:26:00.734401 27061 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T14:26:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (220 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T14:26:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:00Z Disabled control of system clock
I20260811 14:26:00.770413 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46339
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:34913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46339
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/testchainca.cert with env {}
W20260811 14:26:00.865239 27066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:00.865442 27066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:00.865465 27066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:00.866613 27066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:00.866659 27066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:00.866673 27066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:00.866686 27066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:00.866698 27066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:26:00.866710 27066 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:26:00.866722 27066 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 14:26:00.868191 27066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46339
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:00.868402 27066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:00.868563 27066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:00.873373 27076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:00.873405 27074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:00.873452 27066 server_base.cc:1034] running on GCE node
W20260811 14:26:00.873406 27073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:00.873813 27066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:00.874114 27066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:00.875272 27066 hybrid_clock.cc:648] HybridClock initialized: now 1786458360875250 us; error 55 us; skew 500 ppm
I20260811 14:26:00.876593 27066 webserver.cc:460] Webserver started at http://127.20.132.254:43401/ using document root <none> and password file <none>
I20260811 14:26:00.876829 27066 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:00.876899 27066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:00.877046 27066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:00.878074 27066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "e767cfe9728a4a3bafb6a925554e7f59"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "2475c514ed50150fa705f5c72fbd4ab1"
server_key_iv: "d8d596b4f64600b2679656cec6f0e7bf"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.878448 27066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "e767cfe9728a4a3bafb6a925554e7f59"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "2475c514ed50150fa705f5c72fbd4ab1"
server_key_iv: "d8d596b4f64600b2679656cec6f0e7bf"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.879701 27066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:00.880455 27083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:00.880641 27066 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:00.880746 27066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "e767cfe9728a4a3bafb6a925554e7f59"
format_stamp: "Formatted at 2026-08-11 14:26:00 on dist-test-slave-cbbz"
server_key: "2475c514ed50150fa705f5c72fbd4ab1"
server_key_iv: "d8d596b4f64600b2679656cec6f0e7bf"
server_key_version: "encryptionkey@0"
I20260811 14:26:00.880820 27066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:00.889029 27066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:00.889305 27066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:00.889449 27066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:00.893375 27066 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:46339
I20260811 14:26:00.893419 27140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:46339 every 8 connection(s)
I20260811 14:26:00.893754 27066 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:00.894675 27141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:00.894718 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27066
I20260811 14:26:00.894830 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:00.895038 21011 external_mini_cluster.cc:1428] Setting key 0e5fef3ec77a3f258d2fdfed0597609b
I20260811 14:26:00.898201 27141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59: Bootstrap starting.
I20260811 14:26:00.898880 27141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:00.899210 27141 log.cc:824] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:00.899940 27141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59: No bootstrap required, opened a new log
I20260811 14:26:00.901091 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.895552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56966 (local address 127.20.132.254:46339)
0811 14:26:00.895757 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.895764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.895788 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:26:00.896287 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.896294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.896354 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.896464 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:00.896750 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.898016 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.899099 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.899542 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.899678 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.900482 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:00.900487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:00.900487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:00.900651 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:00.900683 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:00.900693 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:00.900765 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:00.900851 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 14:26:00.900932 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260811 14:26:00.902079 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:26:00.902271 27141 raft_consensus.cc:348] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e767cfe9728a4a3bafb6a925554e7f59" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:26:00.902396 27141 raft_consensus.cc:374] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:00.902418 27141 raft_consensus.cc:729] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e767cfe9728a4a3bafb6a925554e7f59, State: Initialized, Role: FOLLOWER
I20260811 14:26:00.902554 27141 consensus_queue.cc:260] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e767cfe9728a4a3bafb6a925554e7f59" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:26:00.902621 27141 raft_consensus.cc:388] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:00.902660 27141 raft_consensus.cc:482] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:00.902709 27141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:00.903348 27141 raft_consensus.cc:504] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e767cfe9728a4a3bafb6a925554e7f59" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:26:00.903432 27141 leader_election.cc:302] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e767cfe9728a4a3bafb6a925554e7f59; no voters:
I20260811 14:26:00.903609 27141 leader_election.cc:288] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:00.903679 27146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:00.903842 27146 raft_consensus.cc:686] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [term 1 LEADER]: Becoming Leader. State: Replica: e767cfe9728a4a3bafb6a925554e7f59, State: Running, Role: LEADER
I20260811 14:26:00.903848 27141 sys_catalog.cc:564] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:00.903945 27146 consensus_queue.cc:237] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e767cfe9728a4a3bafb6a925554e7f59" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:26:00.904376 27147 sys_catalog.cc:455] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e767cfe9728a4a3bafb6a925554e7f59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e767cfe9728a4a3bafb6a925554e7f59" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } } }
I20260811 14:26:00.904382 27148 sys_catalog.cc:455] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e767cfe9728a4a3bafb6a925554e7f59. Latest consensus state: current_term: 1 leader_uuid: "e767cfe9728a4a3bafb6a925554e7f59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e767cfe9728a4a3bafb6a925554e7f59" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } } }
I20260811 14:26:00.904552 27148 sys_catalog.cc:458] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.904541 27147 sys_catalog.cc:458] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:00.904955 27157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:00.905462 27157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:00.906971 27157 catalog_manager.cc:1347] Generated new cluster ID: 71ed9a97c28e426f8e359b998904ab1a
I20260811 14:26:00.907024 27157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:00.937947 27157 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:00.938495 27157 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:00.945696 27157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e767cfe9728a4a3bafb6a925554e7f59: Generated new TSK 0
I20260811 14:26:00.945881 27157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:26:01.390300 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:00.959817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56980 (local address 127.20.132.254:46339)
0811 14:26:00.959884 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:00.959886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:00.960033 (+ 147us) server_negotiation.cc:407] Connection header received
0811 14:26:00.960125 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:00.960125 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:00.960149 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:00.960242 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:26:00.960389 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.960847 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.961958 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.962155 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.962205 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.962423 (+ 218us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:26:01.390074 (+427651us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 14:26:01.390240 (+ 166us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56980: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 14:26:01.390407 27144 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56980: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 14:26:01.390669 27177 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:00.959768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46339 (local address 127.0.0.1:56980)
0811 14:26:00.959954 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:00.959967 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:00.960041 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:00.960249 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:00.960250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:00.960252 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:26:00.960319 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.960322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.960932 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.960933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.961861 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:00.961864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:00.962241 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:00.962242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:00.962306 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:00.962312 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:26:01.390235 (+427923us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 14:26:01.390383 (+ 148us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.132.254:46339: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":108,"threads_started":1}
I20260811 14:26:01.391067 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27066
2026-08-11T14:26:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (649 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (90 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (92 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:01 dist-test-slave-cbbz krb5kdc[27189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:01 dist-test-slave-cbbz krb5kdc[27189](info): set up 2 sockets
Aug 11 14:26:01 dist-test-slave-cbbz krb5kdc[27189](info): commencing operation
krb5kdc: starting...
W20260811 14:26:02.673336 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:02 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:26:02.795480 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34883
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:34883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:02.875881 27204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:02.876127 27204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:02.876159 27204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:02.877336 27204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:02.877410 27204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:02.877434 27204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:02.877462 27204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:02.877493 27204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:02.878947 27204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:34883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:02.879226 27204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:02.879452 27204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:02.884322 27215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:02.884346 27210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:02.884323 27213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:02.884570 27204 server_base.cc:1034] running on GCE node
I20260811 14:26:02.884815 27204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:02.885138 27204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:02.886299 27204 hybrid_clock.cc:648] HybridClock initialized: now 1786458362886296 us; error 38 us; skew 500 ppm
Aug 11 14:26:02 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458362, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:02.888808 27204 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:26:02.889235 27204 webserver.cc:460] Webserver started at http://127.20.132.254:46409/ using document root <none> and password file <none>
I20260811 14:26:02.889536 27204 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:02.889607 27204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:02.889753 27204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:02.890789 27204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "8def13517e724741a2b56e8a2ede0819"
format_stamp: "Formatted at 2026-08-11 14:26:02 on dist-test-slave-cbbz"
server_key: "6e9685270555f8636c435139f9cdc99b"
server_key_iv: "a79e04638bc9b279d51ef8269d674c5c"
server_key_version: "encryptionkey@0"
I20260811 14:26:02.891178 27204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "8def13517e724741a2b56e8a2ede0819"
format_stamp: "Formatted at 2026-08-11 14:26:02 on dist-test-slave-cbbz"
server_key: "6e9685270555f8636c435139f9cdc99b"
server_key_iv: "a79e04638bc9b279d51ef8269d674c5c"
server_key_version: "encryptionkey@0"
I20260811 14:26:02.892515 27204 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:02.893251 27222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:02.893433 27204 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:02.893530 27204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8def13517e724741a2b56e8a2ede0819"
format_stamp: "Formatted at 2026-08-11 14:26:02 on dist-test-slave-cbbz"
server_key: "6e9685270555f8636c435139f9cdc99b"
server_key_iv: "a79e04638bc9b279d51ef8269d674c5c"
server_key_version: "encryptionkey@0"
I20260811 14:26:02.893615 27204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:02.908656 27204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:02.910897 27204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:02.911054 27204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:02.915046 27204 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:34883
I20260811 14:26:02.915088 27279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:34883 every 8 connection(s)
I20260811 14:26:02.915421 27204 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:02.916357 27280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:02.918599 27280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819: Bootstrap starting.
I20260811 14:26:02.919170 27280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:02.919462 27280 log.cc:824] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:02.919912 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27204
I20260811 14:26:02.920020 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:02.920265 21011 external_mini_cluster.cc:1428] Setting key 44bcaf0d2f7fd24946697b13d3e7e3b1
I20260811 14:26:02.920284 27280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819: No bootstrap required, opened a new log
I20260811 14:26:02.922194 27280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def13517e724741a2b56e8a2ede0819" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34883 } }
I20260811 14:26:02.922345 27280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:02.922394 27280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8def13517e724741a2b56e8a2ede0819, State: Initialized, Role: FOLLOWER
I20260811 14:26:02.922528 27280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def13517e724741a2b56e8a2ede0819" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34883 } }
I20260811 14:26:02.922585 27280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:02.922626 27280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:02.922672 27280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:02.923198 27280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def13517e724741a2b56e8a2ede0819" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34883 } }
I20260811 14:26:02.923281 27280 leader_election.cc:302] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8def13517e724741a2b56e8a2ede0819; no voters:
I20260811 14:26:02.923454 27280 leader_election.cc:288] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:02.923480 27285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:02.923609 27285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [term 1 LEADER]: Becoming Leader. State: Replica: 8def13517e724741a2b56e8a2ede0819, State: Running, Role: LEADER
I20260811 14:26:02.923713 27280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:02.923749 27285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def13517e724741a2b56e8a2ede0819" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34883 } }
I20260811 14:26:02.924098 27285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8def13517e724741a2b56e8a2ede0819. Latest consensus state: current_term: 1 leader_uuid: "8def13517e724741a2b56e8a2ede0819" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def13517e724741a2b56e8a2ede0819" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34883 } } }
I20260811 14:26:02.924142 27286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8def13517e724741a2b56e8a2ede0819" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8def13517e724741a2b56e8a2ede0819" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34883 } } }
I20260811 14:26:02.924288 27286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:02.924505 27285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:02.924939 27294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:02.925412 27294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:02.927089 27294 catalog_manager.cc:1347] Generated new cluster ID: f67a1131768f48b098c903fe01f3edbb
I20260811 14:26:02.927146 27294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:26:02 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:02.932032 27284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:02.920764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48516 (local address 127.20.132.254:34883)
0811 14:26:02.921008 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:02.921016 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:02.921041 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:26:02.921529 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:02.921535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:02.921580 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:02.921726 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:02.922390 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:02.923819 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:02.924983 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:02.925583 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:02.925994 (+ 411us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:02.928535 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:02.928539 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:02.928539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:02.928551 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:02.930447 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:02.930856 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:02.930859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:02.930859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:02.930955 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:02.931188 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:02.931189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:02.931189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:02.931455 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:02.931610 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:02.931730 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 14:26:02.931851 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
I20260811 14:26:02.938555 27294 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:02.939237 27294 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:02.947043 27294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8def13517e724741a2b56e8a2ede0819: Generated new TSK 0
I20260811 14:26:02.947224 27294 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:26:02.983697 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34883
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:03.065169 27307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:03.065378 27307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:03.065402 27307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:03.066598 27307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:03.066641 27307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:03.066668 27307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:03.068172 27307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:03.068415 27307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:03.068663 27307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:03.073559 27317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:03.073581 27312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:03.073594 27313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:03.073985 27307 server_base.cc:1034] running on GCE node
I20260811 14:26:03.074218 27307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:03.074446 27307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:03.075609 27307 hybrid_clock.cc:648] HybridClock initialized: now 1786458363075591 us; error 27 us; skew 500 ppm
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.078198 27307 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:26:03.078629 27307 webserver.cc:460] Webserver started at http://127.20.132.193:32871/ using document root <none> and password file <none>
I20260811 14:26:03.078804 27307 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:03.078843 27307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:03.078940 27307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:03.079911 27307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "7d8cc0af0d9f4db795472ae7ab47a5d1"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "c59379d028047d2cb23d8e3e5ef5916f"
server_key_iv: "a70cb2a7518b9164238f535c9ca1cd73"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.080292 27307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "7d8cc0af0d9f4db795472ae7ab47a5d1"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "c59379d028047d2cb23d8e3e5ef5916f"
server_key_iv: "a70cb2a7518b9164238f535c9ca1cd73"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.081557 27307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:03.082261 27324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.082420 27307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:03.082490 27307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "7d8cc0af0d9f4db795472ae7ab47a5d1"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "c59379d028047d2cb23d8e3e5ef5916f"
server_key_iv: "a70cb2a7518b9164238f535c9ca1cd73"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.082541 27307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:03.096113 27307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:03.098174 27307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:03.098287 27307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:03.098467 27307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:03.098714 27307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:03.098747 27307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.098768 27307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:03.098781 27307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.104692 27307 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:36907
I20260811 14:26:03.104736 27458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:36907 every 8 connection(s)
I20260811 14:26:03.105126 27307 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:03.109036 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27307
I20260811 14:26:03.109134 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:03.109329 21011 external_mini_cluster.cc:1428] Setting key efb953fa022e57069817a41474dfbb45
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:03.116334 27284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.106554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:41405 (local address 127.20.132.254:34883)
0811 14:26:03.106617 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.106619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.106826 (+ 207us) server_negotiation.cc:407] Connection header received
0811 14:26:03.107806 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.107807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.107820 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.107872 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.108598 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.109199 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.110399 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.110627 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.110721 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.113354 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:03.113356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:03.113356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:03.113364 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:03.114887 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.115319 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.115320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.115321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.115384 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.115653 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.115654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.115654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.115773 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:03.115853 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:03.116132 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 14:26:03.116243 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:26:03.116523 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.106513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34883 (local address 127.20.132.193:41405)
0811 14:26:03.106700 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:03.106747 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:03.107682 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:03.107938 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:03.107942 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:03.108295 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:03.108486 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:03.108491 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.109281 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.109283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:03.110309 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:03.110311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.110735 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.110736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:03.110859 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.111414 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:03.111438 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:03.113256 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:03.114994 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:03.115002 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:03.115004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:03.115238 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:03.115463 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:03.115464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:03.115464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:03.115574 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:03.115843 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:03.115851 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:03.115990 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 14:26:03.116096 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 14:26:03.116280 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260811 14:26:03.116963 27459 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34883
I20260811 14:26:03.117054 27459 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:03.117238 27459 heartbeater.cc:511] Master 127.20.132.254:34883 requested a full tablet report, sending...
I20260811 14:26:03.117744 27239 ts_manager.cc:194] Registered new tserver with Master: 7d8cc0af0d9f4db795472ae7ab47a5d1 (127.20.132.193:36907)
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
I20260811 14:26:03.118430 27239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:41405
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:26:03.135036 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34883
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:03.217216 27464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:03.217489 27464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:03.217525 27464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:03.218834 27464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:03.218878 27464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:03.218904 27464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:03.220420 27464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:03.220607 27464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:03.220769 27464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:03.225754 27469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:03.225760 27470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:03.225989 27464 server_base.cc:1034] running on GCE node
W20260811 14:26:03.225834 27472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:03.226284 27464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:03.226548 27464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:03.227711 27464 hybrid_clock.cc:648] HybridClock initialized: now 1786458363227710 us; error 37 us; skew 500 ppm
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.230350 27464 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:26:03.230746 27464 webserver.cc:460] Webserver started at http://127.20.132.194:44531/ using document root <none> and password file <none>
I20260811 14:26:03.230922 27464 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:03.230962 27464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:03.231052 27464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:03.232038 27464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "4558401aa79c451aa66daf5f88545b77"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "878ff96a3bba0bd338670b640e7ca929"
server_key_iv: "1459a41015784323b3ae24e3ecd58d9b"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.232424 27464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "4558401aa79c451aa66daf5f88545b77"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "878ff96a3bba0bd338670b640e7ca929"
server_key_iv: "1459a41015784323b3ae24e3ecd58d9b"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.233698 27464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:03.234377 27479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.234529 27464 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:03.234618 27464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "4558401aa79c451aa66daf5f88545b77"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "878ff96a3bba0bd338670b640e7ca929"
server_key_iv: "1459a41015784323b3ae24e3ecd58d9b"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.234670 27464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:03.242457 27464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:03.244238 27464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:03.244347 27464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:03.244517 27464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:03.244750 27464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:03.244778 27464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.244798 27464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:03.244812 27464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.250473 27464 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:38887
I20260811 14:26:03.250557 27610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:38887 every 8 connection(s)
I20260811 14:26:03.250851 27464 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:03.259780 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27464
I20260811 14:26:03.259934 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:03.260213 21011 external_mini_cluster.cc:1428] Setting key ada5d340119021f9124d214e24568303
I20260811 14:26:03.260627 27284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.251699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:38809 (local address 127.20.132.254:34883)
0811 14:26:03.251781 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.251784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.251916 (+ 132us) server_negotiation.cc:407] Connection header received
0811 14:26:03.252959 (+ 1043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.252960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.252971 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.253023 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.253662 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.254147 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.255184 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.255372 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.255427 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.257828 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:03.257830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:03.257830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:03.257837 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:03.259112 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.259515 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.259516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.259516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.259601 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.259854 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.259855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.259855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.260034 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:03.260097 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:03.260439 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 14:26:03.260524 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:26:03.260792 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.251624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34883 (local address 127.20.132.194:38809)
0811 14:26:03.251783 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:03.251823 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:03.252862 (+ 1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:03.253091 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:03.253095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:03.253376 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:03.253587 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:03.253592 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.254229 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.254230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:03.255103 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:03.255106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.255452 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.255453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:03.255558 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.256223 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:03.256231 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:03.257709 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:03.259211 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:03.259219 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:03.259221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:03.259437 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:03.259671 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:03.259672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:03.259672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:03.259778 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:03.260087 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:03.260102 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:03.260281 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 14:26:03.260405 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 14:26:03.260561 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260811 14:26:03.261278 27611 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34883
I20260811 14:26:03.261400 27611 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:03.261615 27611 heartbeater.cc:511] Master 127.20.132.254:34883 requested a full tablet report, sending...
I20260811 14:26:03.262070 27239 ts_manager.cc:194] Registered new tserver with Master: 4558401aa79c451aa66daf5f88545b77 (127.20.132.194:38887)
I20260811 14:26:03.262495 27239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:38809
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:26:03.287039 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34883
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:03.368366 27617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:03.368562 27617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:03.368585 27617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:03.369767 27617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:03.369809 27617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:03.369835 27617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:03.371322 27617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:03.371552 27617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:03.371799 27617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:03.376724 27624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:03.376724 27626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:03.376739 27623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:03.376966 27617 server_base.cc:1034] running on GCE node
I20260811 14:26:03.377157 27617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:03.377396 27617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:03.378559 27617 hybrid_clock.cc:648] HybridClock initialized: now 1786458363378555 us; error 37 us; skew 500 ppm
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.381150 27617 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:26:03.381570 27617 webserver.cc:460] Webserver started at http://127.20.132.195:38859/ using document root <none> and password file <none>
I20260811 14:26:03.381801 27617 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:03.381856 27617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:03.382000 27617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:03.383020 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "82241bd755494e0ea127389af503e19a"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "6635a22012cc2c39758d8a18a2e4f6ee"
server_key_iv: "d8056aae209273816dd5ccc391673234"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.383376 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "82241bd755494e0ea127389af503e19a"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "6635a22012cc2c39758d8a18a2e4f6ee"
server_key_iv: "d8056aae209273816dd5ccc391673234"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.384789 27617 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:03.385573 27633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.385739 27617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:03.385820 27617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "82241bd755494e0ea127389af503e19a"
format_stamp: "Formatted at 2026-08-11 14:26:03 on dist-test-slave-cbbz"
server_key: "6635a22012cc2c39758d8a18a2e4f6ee"
server_key_iv: "d8056aae209273816dd5ccc391673234"
server_key_version: "encryptionkey@0"
I20260811 14:26:03.385874 27617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:03.392179 27617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:03.394341 27617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:03.394449 27617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:03.394610 27617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:03.394843 27617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:03.394872 27617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.394892 27617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:03.394905 27617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:03.401162 27617 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43267
I20260811 14:26:03.401226 27768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43267 every 8 connection(s)
I20260811 14:26:03.401501 27617 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:03.410130 27284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.402160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:39639 (local address 127.20.132.254:34883)
0811 14:26:03.402235 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.402237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.402439 (+ 202us) server_negotiation.cc:407] Connection header received
0811 14:26:03.403294 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.403295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.403305 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.403357 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.403890 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.404449 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.405395 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.405579 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.405628 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.407685 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:03.407686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:03.407686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:03.407692 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:03.408951 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.409354 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.409355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.409355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.409403 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.409635 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.409636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.409636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.409731 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:03.409781 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:03.410000 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 14:26:03.410056 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:26:03.410285 27771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.402133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34883 (local address 127.20.132.195:39639)
0811 14:26:03.402318 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:03.402352 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:03.403213 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:03.403404 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:03.403407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:03.403638 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:03.403811 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:03.403815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.404553 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.404554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:03.405324 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:03.405326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.405650 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.405650 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:03.405745 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.406243 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:03.406250 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:03.407604 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:03.409044 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:03.409050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:03.409051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:03.409285 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:03.409478 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:03.409479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:03.409479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:03.409578 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:03.409788 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:03.409793 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:03.409896 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 14:26:03.409975 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:26:03.410084 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":109,"threads_started":1}
I20260811 14:26:03.410828 27769 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34883
I20260811 14:26:03.410938 27769 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:03.411113 27769 heartbeater.cc:511] Master 127.20.132.254:34883 requested a full tablet report, sending...
I20260811 14:26:03.411514 27239 ts_manager.cc:194] Registered new tserver with Master: 82241bd755494e0ea127389af503e19a (127.20.132.195:43267)
I20260811 14:26:03.411763 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27617
I20260811 14:26:03.411885 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:03.411963 27239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:39639
I20260811 14:26:03.412086 21011 external_mini_cluster.cc:1428] Setting key 4c1f880a38e606135fa7a03288cedcc4
I20260811 14:26:03.413067 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/test-admin.keytab.
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.429886 21011 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 14:26:03.431730 27776 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:03.430775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49646 (local address 127.20.132.193:36907)
0811 14:26:03.431035 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.431043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.431059 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:26:03.431086 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.431087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.431103 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.431185 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.431629 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49646: BlockingRecv error: recv got EOF from 127.0.0.1:49646 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":137,"threads_started":1}
W20260811 14:26:03.431846 21011 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc' of type FILE
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.432883 21011 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.433753 21011 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:26:03.441368 27776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.434268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49658 (local address 127.20.132.193:36907)
0811 14:26:03.434331 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.434333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.434377 (+ 44us) server_negotiation.cc:407] Connection header received
0811 14:26:03.434432 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.434433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.434443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.434483 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.434861 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.435575 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.436336 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.436660 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.436715 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.438867 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:03.438874 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:03.438875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:03.438881 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:03.440342 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.440640 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.440642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.440643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.440693 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.440854 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.440854 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.440854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.440974 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:03.441079 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:03.441153 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 14:26:03.441209 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 14:26:03.443137 27776 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:03.442615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49664 (local address 127.20.132.193:36907)
0811 14:26:03.442649 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.442650 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.442696 (+ 46us) server_negotiation.cc:407] Connection header received
0811 14:26:03.442743 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.442743 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.442751 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.442799 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.443089 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49664: BlockingRecv error: recv got EOF from 127.0.0.1:49664 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 14:26:03.443374 21011 init.cc:244] Error while opening credential cache '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc)
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.444448 21011 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.445338 21011 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:26:03.452623 27776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.445877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49674 (local address 127.20.132.193:36907)
0811 14:26:03.445928 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.445929 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.445978 (+ 49us) server_negotiation.cc:407] Connection header received
0811 14:26:03.446036 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.446036 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.446045 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.446089 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.446432 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.446920 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.447780 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.447969 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.448024 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.450051 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:03.450052 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:03.450053 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:03.450058 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:03.451436 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.451782 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.451783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.451783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.451842 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.452015 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.452015 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.452015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.452101 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:03.452305 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:03.452418 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 14:26:03.452477 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 14:26:03.454255 27776 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:03.453578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49684 (local address 127.20.132.193:36907)
0811 14:26:03.453645 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.453647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.453733 (+ 86us) server_negotiation.cc:407] Connection header received
0811 14:26:03.453834 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.453835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.453863 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.453925 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.454208 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49684: BlockingRecv error: recv got EOF from 127.0.0.1:49684 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 14:26:03.454340 21011 init.cc:244] Error while opening credential cache '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786458335845753-21011-0/krb5kdc/krb5cc)
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.455305 21011 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:03.456338 21011 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:26:03.463231 27776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:03.456833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49694 (local address 127.20.132.193:36907)
0811 14:26:03.456891 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:03.456893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:03.456924 (+ 31us) server_negotiation.cc:407] Connection header received
0811 14:26:03.457010 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:03.457011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:03.457020 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:03.457062 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:03.457438 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.457929 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.458626 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:03.458808 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:03.458881 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:03.461033 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:03.461035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:03.461035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:03.461046 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:03.462145 (+ 1099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.462495 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.462496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.462497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.462553 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:03.462771 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:03.462771 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:03.462772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:03.462865 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:03.462956 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:03.463075 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 14:26:03.463143 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:26:03.463831 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27307
I20260811 14:26:03.471984 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27464
I20260811 14:26:03.478791 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27617
I20260811 14:26:03.484279 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27204
2026-08-11T14:26:03Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1912 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27791](info): set up 2 sockets
Aug 11 14:26:03 dist-test-slave-cbbz krb5kdc[27791](info): commencing operation
krb5kdc: starting...
W20260811 14:26:04.574735 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:04 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:04Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab.
Entry for principal oryx/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab.
I20260811 14:26:04.699992 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46271
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab
--principal=oryx/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:04.780720 27806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:04.780967 27806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:04.781004 27806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:04.782189 27806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:04.782267 27806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:04.782294 27806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:04.782322 27806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:04.782352 27806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:04.783830 27806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab
--principal=oryx/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:04.784107 27806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:04.784358 27806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:04.788967 27814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:04.788976 27812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:04.788976 27811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:04.789367 27806 server_base.cc:1034] running on GCE node
I20260811 14:26:04.789599 27806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:04.789876 27806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:04.791041 27806 hybrid_clock.cc:648] HybridClock initialized: now 1786458364791017 us; error 40 us; skew 500 ppm
Aug 11 14:26:04 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:04.796991 27806 init.cc:377] Logged in from keytab as oryx/127.20.132.254@KRBTEST.COM (short username oryx)
I20260811 14:26:04.797497 27806 webserver.cc:460] Webserver started at http://127.20.132.254:41891/ using document root <none> and password file <none>
I20260811 14:26:04.797706 27806 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:04.797751 27806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:04.797849 27806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:04.798957 27806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "a65b200ad3f34472807804529267934c"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "4da8fd7bf099c179e4b638c2ed30b0c6"
server_key_iv: "a00411a587357606199568bb7583cb7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:04.799285 27806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "a65b200ad3f34472807804529267934c"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "4da8fd7bf099c179e4b638c2ed30b0c6"
server_key_iv: "a00411a587357606199568bb7583cb7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:04.800734 27806 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:26:04.801468 27823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:04.801658 27806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:04.801756 27806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "a65b200ad3f34472807804529267934c"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "4da8fd7bf099c179e4b638c2ed30b0c6"
server_key_iv: "a00411a587357606199568bb7583cb7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:04.801852 27806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:04.822638 27806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:04.825275 27806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:04.825453 27806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:04.829885 27806 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:46271
I20260811 14:26:04.829953 27885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:46271 every 8 connection(s)
I20260811 14:26:04.830307 27806 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:04.831347 27886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:04.833657 27886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Bootstrap starting.
I20260811 14:26:04.834255 27886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:04.834543 27886 log.cc:824] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:04.834900 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27806
I20260811 14:26:04.834988 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:04.835186 21011 external_mini_cluster.cc:1428] Setting key 6782d751dab3eb53ce9c12e8c71a9aec
I20260811 14:26:04.835354 27886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: No bootstrap required, opened a new log
I20260811 14:26:04.837355 27886 raft_consensus.cc:348] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } }
I20260811 14:26:04.837515 27886 raft_consensus.cc:374] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:04.837556 27886 raft_consensus.cc:729] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a65b200ad3f34472807804529267934c, State: Initialized, Role: FOLLOWER
I20260811 14:26:04.837728 27886 consensus_queue.cc:260] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } }
I20260811 14:26:04.837813 27886 raft_consensus.cc:388] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:04.837857 27886 raft_consensus.cc:482] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:04.837908 27886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:04.838455 27886 raft_consensus.cc:504] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } }
I20260811 14:26:04.838574 27886 leader_election.cc:302] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a65b200ad3f34472807804529267934c; no voters:
I20260811 14:26:04.838789 27886 leader_election.cc:288] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:04.838819 27891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:04.838927 27891 raft_consensus.cc:686] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 LEADER]: Becoming Leader. State: Replica: a65b200ad3f34472807804529267934c, State: Running, Role: LEADER
I20260811 14:26:04.839010 27891 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } }
I20260811 14:26:04.839052 27886 sys_catalog.cc:564] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:04.839370 27891 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } }
I20260811 14:26:04.839447 27891 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:04.839588 27891 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a65b200ad3f34472807804529267934c. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } }
I20260811 14:26:04.839655 27891 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
W20260811 14:26:04.840899 27907 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:26:04.840966 27907 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:26:04.841023 27897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:04.841223 27897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:04.843504 27897 catalog_manager.cc:1347] Generated new cluster ID: 1835bd7f53b94c99ba50a90c0af5e704
I20260811 14:26:04.843556 27897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:26:04 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:04.848199 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:04.835713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34002 (local address 127.20.132.254:46271)
0811 14:26:04.835936 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:04.835944 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:04.835969 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:26:04.836702 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:04.836708 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:04.836767 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:04.836913 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:04.837547 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:04.838931 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:04.840019 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:04.840714 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:04.840828 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:04.844331 (+ 3503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:04.844335 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:04.844336 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:04.844348 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:04.846365 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:04.846749 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:04.846752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:04.846753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:04.846860 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:04.847062 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:04.847063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:04.847063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:04.847436 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:04.847619 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:04.847696 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 14:26:04.847952 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260811 14:26:04.849285 27897 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:04.849970 27897 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:04.853785 27897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Generated new TSK 0
I20260811 14:26:04.853960 27897 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab.
Entry for principal oryx/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab.
I20260811 14:26:04.882741 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:46271
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:04.964938 27915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:04.965210 27915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:04.965238 27915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:04.966410 27915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:04.966456 27915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:04.966483 27915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:04.968034 27915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:46271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:04.968294 27915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:04.968490 27915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:04.973286 27921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:04.973420 27923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:04.973318 27920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:04.973523 27915 server_base.cc:1034] running on GCE node
I20260811 14:26:04.973789 27915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:04.974050 27915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:04.975198 27915 hybrid_clock.cc:648] HybridClock initialized: now 1786458364975179 us; error 37 us; skew 500 ppm
Aug 11 14:26:04 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:04.977887 27915 init.cc:377] Logged in from keytab as oryx/127.20.132.193@KRBTEST.COM (short username oryx)
I20260811 14:26:04.978348 27915 webserver.cc:460] Webserver started at http://127.20.132.193:44997/ using document root <none> and password file <none>
I20260811 14:26:04.978587 27915 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:04.978639 27915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:04.978812 27915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:04.979841 27915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "48ea683de86a4401bbb38baa661be658"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "afd5088187642d3661b579fcfd79561c"
server_key_iv: "bcf93504bf949347c91e031b1b141755"
server_key_version: "encryptionkey@0"
I20260811 14:26:04.980252 27915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "48ea683de86a4401bbb38baa661be658"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "afd5088187642d3661b579fcfd79561c"
server_key_iv: "bcf93504bf949347c91e031b1b141755"
server_key_version: "encryptionkey@0"
I20260811 14:26:04.981564 27915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:04.982336 27931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:04.982503 27915 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:04.982604 27915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "48ea683de86a4401bbb38baa661be658"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "afd5088187642d3661b579fcfd79561c"
server_key_iv: "bcf93504bf949347c91e031b1b141755"
server_key_version: "encryptionkey@0"
I20260811 14:26:04.982693 27915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:04.998701 27915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:05.001087 27915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:05.001260 27915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:05.001494 27915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:05.001834 27915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:05.001888 27915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.001931 27915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:05.001960 27915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.008023 27915 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:46793
I20260811 14:26:05.008127 28056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:46793 every 8 connection(s)
I20260811 14:26:05.008481 27915 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:05.017892 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 27915
I20260811 14:26:05.018007 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:05.018257 21011 external_mini_cluster.cc:1428] Setting key 85ff22abad4e071c4b9f53d6d7537c36
I20260811 14:26:05.018261 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.009206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:56305 (local address 127.20.132.254:46271)
0811 14:26:05.009282 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.009285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.009545 (+ 260us) server_negotiation.cc:407] Connection header received
0811 14:26:05.010153 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.010154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.010167 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.010219 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.011191 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.011716 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.012789 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.012999 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.013085 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.015329 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.015330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.015331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.015337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.016764 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.017268 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.017269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.017269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.017323 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.017548 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.017549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.017549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.017648 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.017714 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.018093 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.018194 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:26:05.018443 28062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.009168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:56305)
0811 14:26:05.009431 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.009464 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.010031 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.010294 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.010299 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.010866 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.011062 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.011067 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.011818 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.011820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.012681 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.012683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.013098 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.013099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.013247 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.013764 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.013774 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.015224 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.016848 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.016855 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.016856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.017194 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.017381 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.017382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.017382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.017489 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.017728 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.017735 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.017899 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.018026 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.018198 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":206,"threads_started":1}
I20260811 14:26:05.019174 28058 heartbeater.cc:347] Connected to a master server at 127.20.132.254:46271
I20260811 14:26:05.019289 28058 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:05.019474 28058 heartbeater.cc:511] Master 127.20.132.254:46271 requested a full tablet report, sending...
I20260811 14:26:05.019942 27841 ts_manager.cc:194] Registered new tserver with Master: 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793)
I20260811 14:26:05.020583 27841 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:56305
WARNING: no policy specified for oryx/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab.
Entry for principal oryx/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab.
I20260811 14:26:05.042963 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:46271
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:05.124361 28065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:05.124557 28065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:05.124579 28065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:05.125665 28065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:05.125699 28065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:05.125725 28065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:05.127094 28065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:46271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:05.127293 28065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:05.127461 28065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:05.132405 28071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.132460 28070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.132408 28074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.132575 28065 server_base.cc:1034] running on GCE node
I20260811 14:26:05.132819 28065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:05.133082 28065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:05.134253 28065 hybrid_clock.cc:648] HybridClock initialized: now 1786458365134223 us; error 47 us; skew 500 ppm
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:05.136758 28065 init.cc:377] Logged in from keytab as oryx/127.20.132.194@KRBTEST.COM (short username oryx)
I20260811 14:26:05.137256 28065 webserver.cc:460] Webserver started at http://127.20.132.194:45173/ using document root <none> and password file <none>
I20260811 14:26:05.137492 28065 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.137537 28065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.137696 28065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:05.138736 28065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "550d6987e48b415884bcfd20beb7b0b6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "1296195b9133884bc844b37243987674"
server_key_iv: "7abb5779f0b51a200267a86b60f05b7e"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.139093 28065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "550d6987e48b415884bcfd20beb7b0b6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "1296195b9133884bc844b37243987674"
server_key_iv: "7abb5779f0b51a200267a86b60f05b7e"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.140568 28065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:05.141247 28082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.141417 28065 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:05.141516 28065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "550d6987e48b415884bcfd20beb7b0b6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "1296195b9133884bc844b37243987674"
server_key_iv: "7abb5779f0b51a200267a86b60f05b7e"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.141604 28065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.154944 28065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:05.156911 28065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:05.157070 28065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:05.157342 28065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:05.157666 28065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:05.157722 28065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.157763 28065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:05.157789 28065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.163432 28065 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:46529
I20260811 14:26:05.163533 28206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:46529 every 8 connection(s)
I20260811 14:26:05.163829 28065 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:05.167588 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 28065
I20260811 14:26:05.167676 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:05.167879 21011 external_mini_cluster.cc:1428] Setting key 38bc3371bb19a261e26e995869b25c5e
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:05.173573 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.164622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:54609 (local address 127.20.132.254:46271)
0811 14:26:05.164691 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.164694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.164901 (+ 207us) server_negotiation.cc:407] Connection header received
0811 14:26:05.165372 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.165373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.165383 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.165430 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.166339 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.166829 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.167824 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.168117 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.168253 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.170644 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.170646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.170646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.170653 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.171996 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.172539 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.172540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.172540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.172592 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.172916 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.172916 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.172917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.173037 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.173091 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.173441 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.173509 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:26:05.173867 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.164599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:54609)
0811 14:26:05.164771 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.164808 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.165292 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.165487 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.165491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.166067 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.166263 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.166269 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.166908 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.166908 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.167745 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.167748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.168264 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.168265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.168406 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.168978 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.168986 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.170521 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.172083 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.172090 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.172092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.172461 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.172676 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.172677 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.172677 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.172824 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.173109 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.173117 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.173293 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.173415 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.173602 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260811 14:26:05.174460 28208 heartbeater.cc:347] Connected to a master server at 127.20.132.254:46271
I20260811 14:26:05.174572 28208 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:05.174788 28208 heartbeater.cc:511] Master 127.20.132.254:46271 requested a full tablet report, sending...
I20260811 14:26:05.175230 27841 ts_manager.cc:194] Registered new tserver with Master: 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529)
I20260811 14:26:05.175755 27841 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:54609
WARNING: no policy specified for oryx/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab.
Entry for principal oryx/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab.
I20260811 14:26:05.195587 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:46271
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:05.282156 28214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:05.282400 28214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:05.282444 28214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:05.283591 28214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:05.283658 28214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:05.283710 28214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:05.285337 28214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:46271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:05.285610 28214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:05.285902 28214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:05.291030 28222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.291025 28220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.291122 28219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.291466 28214 server_base.cc:1034] running on GCE node
I20260811 14:26:05.291672 28214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:05.291915 28214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:05.293092 28214 hybrid_clock.cc:648] HybridClock initialized: now 1786458365293080 us; error 30 us; skew 500 ppm
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:05.295606 28214 init.cc:377] Logged in from keytab as oryx/127.20.132.195@KRBTEST.COM (short username oryx)
I20260811 14:26:05.296051 28214 webserver.cc:460] Webserver started at http://127.20.132.195:46121/ using document root <none> and password file <none>
I20260811 14:26:05.296315 28214 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.296389 28214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.296538 28214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:05.297564 28214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "191830b8fc8c45f89e22d58b1afa25c9"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8e26a588483626557c31a6be74090ffd"
server_key_iv: "189380db97064e3224bc06cf9f0355ab"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.297936 28214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "191830b8fc8c45f89e22d58b1afa25c9"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8e26a588483626557c31a6be74090ffd"
server_key_iv: "189380db97064e3224bc06cf9f0355ab"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.299342 28214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:05.300043 28229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.300256 28214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:05.300354 28214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "191830b8fc8c45f89e22d58b1afa25c9"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8e26a588483626557c31a6be74090ffd"
server_key_iv: "189380db97064e3224bc06cf9f0355ab"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.300437 28214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.317553 28214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:05.319985 28214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:05.320204 28214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:05.320465 28214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:05.320786 28214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:05.320842 28214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.320887 28214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:05.320912 28214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.326792 28214 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:45525
I20260811 14:26:05.326865 28359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:45525 every 8 connection(s)
I20260811 14:26:05.327206 28214 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:05.331255 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 28214
I20260811 14:26:05.331358 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:05.331537 21011 external_mini_cluster.cc:1428] Setting key a40c8fa2621c0c7f561b8c945e2325d7
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:05.337420 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.328112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:58485 (local address 127.20.132.254:46271)
0811 14:26:05.328237 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.328239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.328399 (+ 160us) server_negotiation.cc:407] Connection header received
0811 14:26:05.329070 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.329071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.329085 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.329153 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.330118 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.330638 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.332063 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.332384 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.332469 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.334616 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.334617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.334618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.334627 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.335931 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.336441 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.336442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.336442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.336505 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.336774 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.336775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.336775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.336895 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.336966 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.337244 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.337327 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 14:26:05.337683 28363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.328023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:58485)
0811 14:26:05.328258 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.328304 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.328973 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.329221 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.329225 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.329816 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.330005 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.330009 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.330744 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.330745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.331974 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.331977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.332478 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.332480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.332620 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.333169 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.333177 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.334513 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.336033 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.336040 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.336042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.336352 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.336573 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.336574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.336574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.336696 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.336969 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.336976 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.337111 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.337222 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.337384 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":116,"threads_started":1}
I20260811 14:26:05.338181 28360 heartbeater.cc:347] Connected to a master server at 127.20.132.254:46271
I20260811 14:26:05.338294 28360 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:05.338498 28360 heartbeater.cc:511] Master 127.20.132.254:46271 requested a full tablet report, sending...
I20260811 14:26:05.338912 27841 ts_manager.cc:194] Registered new tserver with Master: 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195:45525)
I20260811 14:26:05.339332 27841 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:58485
I20260811 14:26:05.343364 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.132.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.253.keytab.
Entry for principal oryx/127.20.132.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.253.keytab.
I20260811 14:26:05.370414 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:43551
--webserver_interface=127.20.132.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.253.keytab
--principal=oryx/127.20.132.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46271,127.20.132.253:43551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:05.452716 28366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:05.452948 28366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:05.452997 28366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:05.454149 28366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:05.454216 28366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:05.454241 28366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:05.454264 28366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:05.454293 28366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:05.455744 28366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46271,127.20.132.253:43551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.253.keytab
--principal=oryx/127.20.132.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:43551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.132.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
W20260811 14:26:05.455883 28366 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.132.254:46271,127.20.132.253:43551'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 14:26:05.456037 28366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:05.456365 28366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:05.461217 28371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.461222 28374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.461223 28372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.461514 28366 server_base.cc:1034] running on GCE node
I20260811 14:26:05.461808 28366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:05.462097 28366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:05.463268 28366 hybrid_clock.cc:648] HybridClock initialized: now 1786458365463246 us; error 41 us; skew 500 ppm
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:05.465983 28366 init.cc:377] Logged in from keytab as oryx/127.20.132.253@KRBTEST.COM (short username oryx)
I20260811 14:26:05.466432 28366 webserver.cc:460] Webserver started at http://127.20.132.253:35509/ using document root <none> and password file <none>
I20260811 14:26:05.466665 28366 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.466735 28366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.466887 28366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:05.467949 28366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/instance:
uuid: "271aacfd18c946b0aec4fefced1729d3"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8ed783efc71cfa6989a5480672c6e971"
server_key_iv: "2a9f0dab5f900c30748d44e505b657e1"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.468360 28366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal/instance:
uuid: "271aacfd18c946b0aec4fefced1729d3"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8ed783efc71cfa6989a5480672c6e971"
server_key_iv: "2a9f0dab5f900c30748d44e505b657e1"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.469707 28366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:05.470428 28381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.470629 28366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:05.470749 28366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
uuid: "271aacfd18c946b0aec4fefced1729d3"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8ed783efc71cfa6989a5480672c6e971"
server_key_iv: "2a9f0dab5f900c30748d44e505b657e1"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.470825 28366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.488247 28366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:05.490262 28366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:05.490432 28366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:05.494589 28366 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.253:43551
I20260811 14:26:05.494642 28441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.253:43551 every 8 connection(s)
I20260811 14:26:05.495025 28366 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
I20260811 14:26:05.495501 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 28366
I20260811 14:26:05.496258 28442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:05.498484 28442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.253@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:05.507014 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.496183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37024 (local address 127.20.132.253:43551)
0811 14:26:05.496422 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.496429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.496455 (+ 26us) server_negotiation.cc:407] Connection header received
0811 14:26:05.496900 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.496907 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.496951 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.497063 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.497867 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.498794 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.499685 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.500330 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.500410 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.503292 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.503299 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.503300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.503307 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.505242 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.505689 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.505692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.505692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.505777 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.505991 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.505992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.505992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.506305 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.506455 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.506626 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.506771 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
I20260811 14:26:05.507524 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.499197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34018 (local address 127.20.132.254:46271)
0811 14:26:05.499249 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.499251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.499387 (+ 136us) server_negotiation.cc:407] Connection header received
0811 14:26:05.499466 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.499468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.499479 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.499525 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.500115 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.500788 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.501610 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.501944 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.502015 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.504388 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.504389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.504390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.504404 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.506050 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.506447 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.506448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.506448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.506513 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.506724 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.506725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.506725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.506896 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.506953 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.507355 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.507437 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 14:26:05.507534 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.499126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34018)
0811 14:26:05.499275 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.499313 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.499402 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.499541 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.499544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.499940 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.500010 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.500012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.500888 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.500889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.501519 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.501522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.502039 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.502040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.502144 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.502574 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.502584 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.504302 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.506132 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.506136 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.506138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.506379 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.506583 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.506583 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.506584 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.506648 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.506965 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.506970 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.507022 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.507313 (+ 291us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.507429 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":92,"threads_started":1}
I20260811 14:26:05.508265 28442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.253@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
I20260811 14:26:05.514564 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.508520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37034)
0811 14:26:05.508574 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.508585 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.508627 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.508726 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.508727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.508903 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.508960 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.508962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.509543 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.509544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.510084 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.510086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.510401 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.510402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.510454 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.510774 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.510778 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.511950 (+ 1172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.513577 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.513578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.513578 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.513740 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.513958 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.513958 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.513959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.514012 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.514255 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.514256 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.514293 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.514361 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.514459 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 14:26:05.514621 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.508575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37034 (local address 127.20.132.253:43551)
0811 14:26:05.508630 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.508632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.508654 (+ 22us) server_negotiation.cc:407] Connection header received
0811 14:26:05.508672 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.508675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.508687 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.508724 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.509032 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.509477 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.510160 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.510344 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.510388 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.512046 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.512047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.512048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.512054 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.513477 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.513838 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.513839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.513839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.513894 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.514082 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.514083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.514084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.514190 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.514263 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.514384 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.514508 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":37}
I20260811 14:26:05.515990 28442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Bootstrap starting.
I20260811 14:26:05.516893 28442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:05.517123 28442 log.cc:824] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:05.517836 28442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: No bootstrap required, opened a new log
I20260811 14:26:05.519284 28442 raft_consensus.cc:348] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } }
I20260811 14:26:05.519404 28442 raft_consensus.cc:374] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:05.519428 28442 raft_consensus.cc:729] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271aacfd18c946b0aec4fefced1729d3, State: Initialized, Role: FOLLOWER
I20260811 14:26:05.519515 28442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } }
I20260811 14:26:05.519779 28442 sys_catalog.cc:564] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:05.519778 28449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } } }
I20260811 14:26:05.519917 28449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 14:26:05.521443 28461 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:26:05.521502 28461 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:26:05.523392 28366 master_runner.cc:428] Detected that this master 271aacfd18c946b0aec4fefced1729d3 is joining an existing cluster
I20260811 14:26:05.523483 28366 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.132.253:43551
I20260811 14:26:05.531731 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.524544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37038)
0811 14:26:05.525145 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.525156 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.525220 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.525365 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.525365 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.525620 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.525702 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.525704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.526574 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.526575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.527463 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.527466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.527907 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.527908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.527983 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.528447 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.528451 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.528808 (+ 357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.530578 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.530579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.530580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.530752 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.530997 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.530997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.530998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.531060 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.531332 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.531333 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.531372 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.531467 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.531581 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":105,"threads_started":1}
I20260811 14:26:05.531795 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.525061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.20.132.253:43551)
0811 14:26:05.525121 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.525122 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.525218 (+ 96us) server_negotiation.cc:407] Connection header received
0811 14:26:05.525280 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.525281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.525288 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.525361 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.525777 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.526486 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.527549 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.527831 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.527905 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.528894 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.528896 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.528896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.528903 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.530472 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.530833 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.530834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.530834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.530927 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.531122 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.531123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.531123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.531250 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.531312 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.531494 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.531664 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":41}
I20260811 14:26:05.532512 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.524636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.20.132.254:46271)
0811 14:26:05.524688 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.524690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.525367 (+ 677us) server_negotiation.cc:407] Connection header received
0811 14:26:05.525451 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.525452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.525466 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.525535 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.525955 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.526677 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.527406 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.527697 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.527761 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.529174 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.529175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.529175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.529183 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.530730 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.531163 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.531164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.531165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.531220 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.531438 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.531439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.531439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.531579 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.531643 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.532364 (+ 721us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.532450 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 14:26:05.532826 28467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.524545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34034)
0811 14:26:05.525316 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.525324 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.525392 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.525564 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.525564 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.525785 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.525868 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.525870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.526757 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.526758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.527311 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.527312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.527784 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.527785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.527850 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.528575 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.528580 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.529054 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.530825 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.530826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.530826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.531051 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.531295 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.531295 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.531296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.531363 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.531672 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.531674 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.531731 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.532612 (+ 881us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.532727 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":2,"thread_start_us":100,"threads_started":1}
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.254@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
I20260811 14:26:05.542936 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.535271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37042 (local address 127.20.132.253:43551)
0811 14:26:05.535315 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.535317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.535501 (+ 184us) server_negotiation.cc:407] Connection header received
0811 14:26:05.535586 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.535586 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.535594 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.535642 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.536172 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.536613 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.537799 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.537987 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.538044 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.540325 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.540326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.540327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.540333 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.541722 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.542134 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.542135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.542136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.542197 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.542399 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.542400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.542400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.542514 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.542584 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.542772 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.542848 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:26:05.542972 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.535189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37042)
0811 14:26:05.535382 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.535432 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.535509 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.535666 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.535669 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.535999 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.536056 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.536058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.536691 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.536692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.537680 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.537683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.538088 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.538090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.538195 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.538621 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.538626 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.540232 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.541839 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.541846 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.541848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.542056 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.542267 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.542268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.542269 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.542334 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.542589 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.542597 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.542648 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.542746 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.542860 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
I20260811 14:26:05.543497 27841 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.132.253:43551: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "271aacfd18c946b0aec4fefced1729d3"
member_type: NON_VOTER
last_known_addr {
host: "127.20.132.253"
port: 43551
}
attrs {
promote: true
}
}
dest_uuid: "a65b200ad3f34472807804529267934c"
cas_config_opid_index: -1
I20260811 14:26:05.543900 27841 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } }
I20260811 14:26:05.544474 28470 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 271aacfd18c946b0aec4fefced1729d3 (127.20.132.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } }
I20260811 14:26:05.544721 28413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:05.545662 28470 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.132.253:43551
I20260811 14:26:05.545683 28413 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Refusing update from remote peer a65b200ad3f34472807804529267934c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 14:26:05.545820 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } }
I20260811 14:26:05.545900 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:05.545976 28366 master.cc:537] Master@127.20.132.253:43551 shutting down...
I20260811 14:26:05.546003 28470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Connected to new peer: Peer: permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:26:05.546772 27826 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 14:26:05.547233 27826 consensus_peers.cc:487] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c -> Peer 271aacfd18c946b0aec4fefced1729d3 (127.20.132.253:43551): Couldn't send request to peer 271aacfd18c946b0aec4fefced1729d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 14:26:05.548869 28366 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:05.548957 28366 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:05.549000 28366 tablet_replica.cc:330] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: stopping tablet replica
I20260811 14:26:05.562709 28366 master.cc:552] Master@127.20.132.253:43551 shutdown complete.
I20260811 14:26:05.562772 28366 master_runner.cc:305] Clearing existing system tablet
I20260811 14:26:05.562907 28366 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.562960 28366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.563721 28366 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.001s
I20260811 14:26:05.564328 28477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.564486 28366 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.564549 28366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:26:05.564574 28366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
uuid: "271aacfd18c946b0aec4fefced1729d3"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8ed783efc71cfa6989a5480672c6e971"
server_key_iv: "2a9f0dab5f900c30748d44e505b657e1"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.565469 28366 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:05.567332 28366 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 14:26:05.567407 28366 log.cc:1196] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 14:26:05.567597 28366 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Deleting consensus metadata
I20260811 14:26:05.567725 28366 master_runner.cc:315] Copying system tablet from 127.20.132.254:46271
I20260811 14:26:05.568403 28366 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: tablet copy: Beginning tablet copy session from remote peer at address 127.20.132.254:46271
I20260811 14:26:05.575224 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.568877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34042 (local address 127.20.132.254:46271)
0811 14:26:05.568925 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.568927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.568987 (+ 60us) server_negotiation.cc:407] Connection header received
0811 14:26:05.569053 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.569054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.569064 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.569109 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.569462 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.569957 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.571021 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.571212 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.571268 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.572589 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.572590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.572590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.572597 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.574046 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.574467 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.574468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.574468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.574520 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.574737 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.574737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.574738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.574836 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.574886 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.575099 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.575160 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 14:26:05.575315 28483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.568771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34042)
0811 14:26:05.568905 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.568917 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.568988 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.569124 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.569125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.569332 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.569394 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.569397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.570036 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.570037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.570934 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.570937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.571420 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.571421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.571501 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.571989 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.571995 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.572487 (+ 492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.574135 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.574136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.574137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.574378 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.574587 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.574588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.574588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.574665 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.574903 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.574904 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.574962 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.575077 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.575189 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":90,"threads_started":1}
I20260811 14:26:05.576050 27867 tablet_copy_service.cc:140] P a65b200ad3f34472807804529267934c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 271aacfd18c946b0aec4fefced1729d3 ({username='oryx', principal='oryx/127.20.132.253@KRBTEST.COM'} at 127.0.0.1:34042)
I20260811 14:26:05.576238 27867 tablet_copy_service.cc:161] P a65b200ad3f34472807804529267934c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 271aacfd18c946b0aec4fefced1729d3 at {username='oryx', principal='oryx/127.20.132.253@KRBTEST.COM'} at 127.0.0.1:34042: session id = 271aacfd18c946b0aec4fefced1729d3-00000000000000000000000000000000
I20260811 14:26:05.577214 27867 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 14:26:05.577919 28366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 14:26:05.578982 28366 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: tablet copy: Starting download of 0 data blocks...
I20260811 14:26:05.579159 28366 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: tablet copy: Starting download of 1 WAL segments...
I20260811 14:26:05.580435 28366 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 14:26:05.581339 27867 tablet_copy_service.cc:342] P a65b200ad3f34472807804529267934c: Request end of tablet copy session 271aacfd18c946b0aec4fefced1729d3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.132.253@KRBTEST.COM'} at 127.0.0.1:34042
I20260811 14:26:05.581408 27867 tablet_copy_service.cc:433] P a65b200ad3f34472807804529267934c: ending tablet copy session 271aacfd18c946b0aec4fefced1729d3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 271aacfd18c946b0aec4fefced1729d3
I20260811 14:26:05.584303 28366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:05.585500 28488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.585559 28484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.585903 28366 server_base.cc:1034] running on GCE node
W20260811 14:26:05.588274 28485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.588464 28366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:05.588626 28366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:05.589757 28366 hybrid_clock.cc:648] HybridClock initialized: now 1786458365589752 us; error 26 us; skew 500 ppm
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:05.591132 28366 init.cc:377] Logged in from keytab as oryx/127.20.132.253@KRBTEST.COM (short username oryx)
I20260811 14:26:05.591434 28366 webserver.cc:460] Webserver started at http://127.20.132.253:37737/ using document root <none> and password file <none>
I20260811 14:26:05.591579 28366 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.591622 28366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.592288 28366 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:05.592912 28496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.593062 28366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:05.593119 28366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
uuid: "271aacfd18c946b0aec4fefced1729d3"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8ed783efc71cfa6989a5480672c6e971"
server_key_iv: "2a9f0dab5f900c30748d44e505b657e1"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.593183 28366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.620769 28366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:05.622583 28366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:05.625689 28366 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.253:43551
I20260811 14:26:05.625720 28560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.253:43551 every 8 connection(s)
I20260811 14:26:05.626029 28366 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
I20260811 14:26:05.626893 28561 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:26:05.627315 28561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Bootstrap starting.
I20260811 14:26:05.629860 28561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:26:05.630115 28561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: Bootstrap complete.
I20260811 14:26:05.630334 28561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } }
I20260811 14:26:05.630424 28561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 271aacfd18c946b0aec4fefced1729d3, State: Initialized, Role: LEARNER
I20260811 14:26:05.630478 28561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } }
I20260811 14:26:05.630659 28561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:05.630686 28565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } }
I20260811 14:26:05.630815 28565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:26:05.632118 28579 catalog_manager.cc:1259] Loaded cluster ID: 1835bd7f53b94c99ba50a90c0af5e704
I20260811 14:26:05.632232 28579 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: loading cluster ID for follower catalog manager: success
I20260811 14:26:05.633306 28579 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: acquiring CA information for follower catalog manager: success
I20260811 14:26:05.633600 28579 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:26:05.666127 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.659321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37086 (local address 127.20.132.253:43551)
0811 14:26:05.659472 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.659474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.659481 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:05.659506 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.659506 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.659516 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.659600 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.660195 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.660871 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.661624 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.661840 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.661918 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.663165 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.663167 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.663167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.663174 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.664742 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.665096 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.665098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.665098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.665157 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.665361 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.665362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.665362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.665521 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.665636 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.665808 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.665922 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for oryx/127.20.132.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.252.keytab.
Entry for principal oryx/127.20.132.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.252.keytab.
I20260811 14:26:05.695912 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:38777
--webserver_interface=127.20.132.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.252.keytab
--principal=oryx/127.20.132.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:05.781308 28583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:05.781553 28583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:05.781594 28583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:05.782796 28583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:05.782871 28583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:05.782900 28583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:05.782949 28583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:05.782982 28583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:05.784606 28583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.252.keytab
--principal=oryx/127.20.132.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:38777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.132.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:05.784898 28583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:05.785169 28583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:05.790266 28591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.790352 28589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.790261 28588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.790534 28583 server_base.cc:1034] running on GCE node
I20260811 14:26:05.790774 28583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:05.791064 28583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:05.792209 28583 hybrid_clock.cc:648] HybridClock initialized: now 1786458365792199 us; error 35 us; skew 500 ppm
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:05.794898 28583 init.cc:377] Logged in from keytab as oryx/127.20.132.252@KRBTEST.COM (short username oryx)
I20260811 14:26:05.795351 28583 webserver.cc:460] Webserver started at http://127.20.132.252:45141/ using document root <none> and password file <none>
I20260811 14:26:05.795583 28583 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.795625 28583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.795814 28583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:05.796875 28583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/instance:
uuid: "48b918eb5fee461b913b5257aaaea7c6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "3355d82c04735b5bf967b18eae798a18"
server_key_iv: "610bebfd71a445ccd66c043effe00e7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.797273 28583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal/instance:
uuid: "48b918eb5fee461b913b5257aaaea7c6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "3355d82c04735b5bf967b18eae798a18"
server_key_iv: "610bebfd71a445ccd66c043effe00e7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.798600 28583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:26:05.799335 28602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.799510 28583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:05.799611 28583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
uuid: "48b918eb5fee461b913b5257aaaea7c6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "3355d82c04735b5bf967b18eae798a18"
server_key_iv: "610bebfd71a445ccd66c043effe00e7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.799688 28583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.828510 28583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:05.830601 28583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:05.830772 28583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:05.835319 28583 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.252:38777
I20260811 14:26:05.835355 28659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.252:38777 every 8 connection(s)
I20260811 14:26:05.835703 28583 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
I20260811 14:26:05.836699 28660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:05.838272 28660 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:26:05.841410 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 28583
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.252@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.132.252@KRBTEST.COM
I20260811 14:26:05.848891 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.839311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34058 (local address 127.20.132.254:46271)
0811 14:26:05.839363 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.839365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.839375 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:05.839865 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.839867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.839876 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.839929 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.840751 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.841280 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.842776 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.842993 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.843070 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.845566 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.845568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.845568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.845576 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.847117 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.847560 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.847561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.847562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.847626 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.847926 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.847927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.847928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.848050 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.848124 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.848684 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.848773 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 14:26:05.849254 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.838993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34058)
0811 14:26:05.839159 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.839196 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.839773 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.840067 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.840071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.840395 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.840626 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.840632 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.841374 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.841375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.842672 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.842676 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.843102 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.843103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.843222 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.843768 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.843775 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.845478 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.847218 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.847226 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.847228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.847473 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.847698 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.847699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.847699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.847857 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.848127 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.848156 (+ 29us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.848298 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.848652 (+ 354us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.849092 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":2,"thread_start_us":79,"threads_started":1}
I20260811 14:26:05.849795 28660 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:26:05.851135 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.841968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.20.132.252:38777)
0811 14:26:05.842161 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.842164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.842179 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:26:05.842198 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.842199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.842215 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.842277 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.842994 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.844004 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.845118 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.845527 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.845605 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.848181 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.848189 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.848189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.848196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.849856 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.850284 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.850287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.850287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.850355 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.850556 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.850557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.850557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.850724 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.850869 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.850953 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.851029 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":113,"threads_started":1}
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.252@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
I20260811 14:26:05.856081 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.850071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37090)
0811 14:26:05.850128 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.850140 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.850185 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.850334 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.850334 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.850477 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.850555 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.850557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.851369 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.851369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.851903 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.851904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.852305 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.852306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.852354 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.852648 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.852652 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.853726 (+ 1074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.855326 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.855327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.855327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.855471 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.855640 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.855641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.855641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.855689 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.855862 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.855863 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.855895 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.855944 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.856009 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 14:26:05.856099 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.850153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37090 (local address 127.20.132.253:43551)
0811 14:26:05.850214 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.850215 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.850224 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:05.850250 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.850251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.850270 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.850316 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.850617 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.851121 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.851977 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.852238 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.852306 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.853811 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.853812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.853812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.853819 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.855257 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.855532 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.855533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.855533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.855584 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.855726 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.855726 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.855727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.855814 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.855858 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.855959 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.856025 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:26:05.856626 28660 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.252@KRBTEST.COM for oryx/127.20.132.252@KRBTEST.COM
I20260811 14:26:05.862478 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.856907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33512)
0811 14:26:05.856955 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.856965 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.857004 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.857125 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.857125 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.857254 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.857278 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.857279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.857882 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.857883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.858336 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.858337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.858702 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.858703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.858758 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.859068 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.859072 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.860117 (+ 1045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.861705 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.861706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.861706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.861870 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.862028 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.862028 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.862029 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.862076 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.862248 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.862248 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.862281 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.862330 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.862400 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 14:26:05.862530 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.856967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.20.132.252:38777)
0811 14:26:05.856999 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.857001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.857009 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:05.857060 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.857061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.857070 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.857122 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.857359 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.857807 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.858414 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.858630 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.858705 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.860245 (+ 1540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.860247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.860247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.860253 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.861629 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.861928 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.861928 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.861928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.861974 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.862113 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.862114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.862114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.862200 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.862243 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.862345 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.862442 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":18}
I20260811 14:26:05.863983 28660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Bootstrap starting.
I20260811 14:26:05.864878 28660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:05.865185 28660 log.cc:824] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:05.865970 28660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: No bootstrap required, opened a new log
I20260811 14:26:05.867434 28660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } }
I20260811 14:26:05.867561 28660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:05.867584 28660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48b918eb5fee461b913b5257aaaea7c6, State: Initialized, Role: FOLLOWER
I20260811 14:26:05.867753 28660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } }
I20260811 14:26:05.868072 28660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:05.868037 28667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } } }
I20260811 14:26:05.868211 28667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 14:26:05.869866 28680 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:26:05.869942 28680 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:26:05.872514 28583 master_runner.cc:428] Detected that this master 48b918eb5fee461b913b5257aaaea7c6 is joining an existing cluster
I20260811 14:26:05.872555 28583 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.132.252:38777
I20260811 14:26:05.883471 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.873859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34062 (local address 127.20.132.254:46271)
0811 14:26:05.873900 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.873902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.876360 (+ 2458us) server_negotiation.cc:407] Connection header received
0811 14:26:05.876449 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.876450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.876465 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.876535 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.877279 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.878033 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879147 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.879450 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879495 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.880808 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.880809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.880809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.880816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.882305 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.882706 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.882706 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.882707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.882759 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.882960 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.882961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.882961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.883064 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.883115 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.883331 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.883403 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:26:05.883494 28687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.873664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34062)
0811 14:26:05.876275 (+ 2611us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.876289 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.876361 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.876678 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.876679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.877061 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.877160 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.877163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.878152 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.878153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.879026 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.879029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.879582 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.879650 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.880215 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.880221 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.880707 (+ 486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.882392 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.882393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.882393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.882629 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.882829 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.882830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.882830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.882898 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.883127 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.883128 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.883183 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.883257 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.883373 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2583,"thread_start_us":83,"threads_started":1}
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458364, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.254@KRBTEST.COM for oryx/127.20.132.252@KRBTEST.COM
I20260811 14:26:05.899713 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.886267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33538)
0811 14:26:05.886320 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.886331 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.886375 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.886631 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.886632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.886789 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.886827 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.886828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.887513 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.887514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.888024 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.888025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.888455 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.888456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.888526 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.888928 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.888933 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.890323 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.898432 (+ 8109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.898433 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.898433 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.898676 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.898933 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.898934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.898934 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.899009 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.899351 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.899352 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.899410 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.899463 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.899589 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:26:05.900194 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.873886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37102 (local address 127.20.132.253:43551)
0811 14:26:05.873932 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.873934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.876687 (+ 2753us) server_negotiation.cc:407] Connection header received
0811 14:26:05.876788 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.876789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.876803 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.876836 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.877267 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.878009 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879701 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.879987 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.880034 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.897305 (+ 17271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.897308 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.897308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.897317 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.898908 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.899319 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.899320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.899320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.899377 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.899571 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.899572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.899572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.899714 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.899760 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.899974 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.900065 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:26:05.900285 28689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.886332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33538 (local address 127.20.132.252:38777)
0811 14:26:05.886500 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.886501 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.886507 (+ 6us) server_negotiation.cc:407] Connection header received
0811 14:26:05.886535 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.886536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.886544 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.886613 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.886903 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.887428 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.888107 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.888369 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.888442 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.890434 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.890437 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.890437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.890449 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.898330 (+ 7881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.898778 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.898779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.898779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.898846 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.899088 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.899089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.899090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.899261 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.899919 (+ 658us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.899976 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.900175 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260811 14:26:05.900671 28688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.873705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37102)
0811 14:26:05.876628 (+ 2923us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.876637 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.876713 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.876905 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.876905 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.877109 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.877179 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.877180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.878095 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.878096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.879556 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.879558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.880117 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.880118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.880215 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.896653 (+ 16438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.896658 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.897172 (+ 514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.899008 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.899008 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.899009 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.899230 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.899447 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.899447 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.899448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.899502 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.899812 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.899813 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.899855 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.900313 (+ 458us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.900562 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2894,"mutex_wait_us":72,"thread_start_us":92,"threads_started":1}
I20260811 14:26:05.901073 27841 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.132.252:38777: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6"
member_type: NON_VOTER
last_known_addr {
host: "127.20.132.252"
port: 38777
}
attrs {
promote: true
}
}
dest_uuid: "a65b200ad3f34472807804529267934c"
cas_config_opid_index: 5
I20260811 14:26:05.901371 27841 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } }
I20260811 14:26:05.901937 28686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.873683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33524)
0811 14:26:05.876454 (+ 2771us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.876466 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.876525 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.876669 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.876670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.877072 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.877162 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.877164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.878080 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.878081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.879132 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.879135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.879671 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879671 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.879729 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.897042 (+ 17313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.897048 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.897989 (+ 941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.900690 (+ 2701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.900690 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.900691 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.900920 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.901224 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.901225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.901225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.901298 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.901605 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.901605 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.901640 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.901693 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.901829 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2751,"mutex_wait_us":103,"thread_start_us":74,"threads_started":1}
I20260811 14:26:05.901850 28470 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.902221 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.873703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33524 (local address 127.20.132.252:38777)
0811 14:26:05.873747 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.873750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.876541 (+ 2791us) server_negotiation.cc:407] Connection header received
0811 14:26:05.876568 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.876568 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.876577 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.876636 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.877254 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.877988 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879224 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.879523 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.879559 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.898373 (+ 18814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.898374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.898374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.898382 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.900050 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.901092 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.901093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.901093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.901151 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.901387 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.901388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.901389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.901514 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.901579 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.902066 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.902144 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:26:05.902287 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27915
I20260811 14:26:05.902962 28470 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.132.252:38777
I20260811 14:26:05.903050 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.903133 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:05.910622 28583 master.cc:537] Master@127.20.132.252:38777 shutting down...
W20260811 14:26:05.913928 27824 consensus_peers.cc:487] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c -> Peer 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252:38777): Couldn't send request to peer 48b918eb5fee461b913b5257aaaea7c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 14:26:05.917960 28583 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:05.918076 28583 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:05.918121 28583 tablet_replica.cc:330] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: stopping tablet replica
I20260811 14:26:05.919152 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.903393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37108)
0811 14:26:05.914047 (+ 10654us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.914061 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.914106 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.915340 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.915341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.915343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:05.915417 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.915419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.916449 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.916450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.917693 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.917697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.918727 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.918728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.918917 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.918946 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.919007 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.919056 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10630}
I20260811 14:26:05.919185 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:46793
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:46271
--webserver_port=44997
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:26:05.919492 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.913139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37108 (local address 127.20.132.253:43551)
0811 14:26:05.915071 (+ 1932us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.915074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.915084 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:05.915115 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.915116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.915146 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.915237 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:05.915509 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.916340 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.917806 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.918452 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.918524 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.918601 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.919346 (+ 745us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.919408 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1902}
I20260811 14:26:05.919929 28530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 LEARNER]: Refusing update from remote peer a65b200ad3f34472807804529267934c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 14:26:05.920261 28471 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Connected to new peer: Peer: permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 14:26:05.920917 28530 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.922313 28565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a65b200ad3f34472807804529267934c. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.922423 28565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:26:05.922464 28565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: NON_VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: true } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.922511 28565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:26:05.922539 28471 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: attempting to promote NON_VOTER 271aacfd18c946b0aec4fefced1729d3 to VOTER
I20260811 14:26:05.922744 28471 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } }
I20260811 14:26:05.923260 28530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 LEARNER]: Refusing update from remote peer a65b200ad3f34472807804529267934c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 14:26:05.923314 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.923181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33552)
0811 14:26:05.923225 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.923285 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:38777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 14:26:05.923653 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.923558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33558)
0811 14:26:05.923590 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.923618 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:38777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 14:26:05.923511 28693 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Connected to new peer: Peer: permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 14:26:05.923851 27824 consensus_peers.cc:487] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c -> Peer 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252:38777): Couldn't send request to peer 48b918eb5fee461b913b5257aaaea7c6. Status: Network error: Client connection negotiation failed: client connection to 127.20.132.252:38777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 14:26:05.924638 28471 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 271aacfd18c946b0aec4fefced1729d3 (127.20.132.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.924836 28530 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 271aacfd18c946b0aec4fefced1729d3 (127.20.132.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.925721 28471 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.925796 28471 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:05.925848 28471 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.925887 28471 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:05.926049 28692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:05.926173 28692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:26:05.932871 28583 master.cc:552] Master@127.20.132.252:38777 shutdown complete.
I20260811 14:26:05.932933 28583 master_runner.cc:305] Clearing existing system tablet
I20260811 14:26:05.933071 28583 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.933123 28583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.933923 28583 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:05.934489 28697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.934753 28583 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:05.934821 28583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:05.934847 28583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
uuid: "48b918eb5fee461b913b5257aaaea7c6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "3355d82c04735b5bf967b18eae798a18"
server_key_iv: "610bebfd71a445ccd66c043effe00e7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.935673 28583 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:05.937379 28583 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 14:26:05.937458 28583 log.cc:1196] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 14:26:05.937664 28583 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Deleting consensus metadata
I20260811 14:26:05.937966 28583 master_runner.cc:315] Copying system tablet from 127.20.132.254:46271
I20260811 14:26:05.938629 28583 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: tablet copy: Beginning tablet copy session from remote peer at address 127.20.132.254:46271
I20260811 14:26:05.947912 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.940497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34078 (local address 127.20.132.254:46271)
0811 14:26:05.940547 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:05.940550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:05.940706 (+ 156us) server_negotiation.cc:407] Connection header received
0811 14:26:05.940781 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:05.940782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:05.940794 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:05.940874 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:05.941288 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.942120 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.943213 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.943524 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.943595 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.944977 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:05.944978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:05.944979 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:05.944987 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:05.946657 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.947073 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.947074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.947074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.947137 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:05.947353 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:05.947354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:05.947354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:05.947486 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:05.947553 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:05.947722 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 14:26:05.947809 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:26:05.947923 28703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:05.940449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34078)
0811 14:26:05.940629 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:05.940641 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:05.940717 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:05.940896 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:05.940897 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:05.941130 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:05.941209 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.941211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.942218 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.942219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.943121 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:05.943124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:05.943629 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:05.943630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:05.943713 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:05.944386 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:05.944392 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:05.944863 (+ 471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:05.946756 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.946757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.946757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.946991 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.947213 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:05.947214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:05.947214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:05.947285 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:05.947557 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:05.947558 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:05.947607 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 14:26:05.947683 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:26:05.947804 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":83,"threads_started":1}
I20260811 14:26:05.948561 27867 tablet_copy_service.cc:140] P a65b200ad3f34472807804529267934c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 48b918eb5fee461b913b5257aaaea7c6 ({username='oryx', principal='oryx/127.20.132.252@KRBTEST.COM'} at 127.0.0.1:34078)
I20260811 14:26:05.948632 27867 tablet_copy_service.cc:161] P a65b200ad3f34472807804529267934c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 48b918eb5fee461b913b5257aaaea7c6 at {username='oryx', principal='oryx/127.20.132.252@KRBTEST.COM'} at 127.0.0.1:34078: session id = 48b918eb5fee461b913b5257aaaea7c6-00000000000000000000000000000000
I20260811 14:26:05.949255 27867 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 14:26:05.949774 28583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 14:26:05.951129 28583 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: tablet copy: Starting download of 0 data blocks...
I20260811 14:26:05.951292 28583 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: tablet copy: Starting download of 1 WAL segments...
I20260811 14:26:05.952107 28583 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 14:26:05.953030 27867 tablet_copy_service.cc:342] P a65b200ad3f34472807804529267934c: Request end of tablet copy session 48b918eb5fee461b913b5257aaaea7c6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.132.252@KRBTEST.COM'} at 127.0.0.1:34078
I20260811 14:26:05.953089 27867 tablet_copy_service.cc:433] P a65b200ad3f34472807804529267934c: ending tablet copy session 48b918eb5fee461b913b5257aaaea7c6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 48b918eb5fee461b913b5257aaaea7c6
I20260811 14:26:05.956027 28583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:05.957142 28704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:05.957228 28708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.957698 28583 server_base.cc:1034] running on GCE node
W20260811 14:26:05.964283 28706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:05.964515 28583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:05.964675 28583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:05.965801 28583 hybrid_clock.cc:648] HybridClock initialized: now 1786458365965780 us; error 43 us; skew 500 ppm
Aug 11 14:26:05 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458365, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:05.967397 28583 init.cc:377] Logged in from keytab as oryx/127.20.132.252@KRBTEST.COM (short username oryx)
I20260811 14:26:05.967687 28583 webserver.cc:460] Webserver started at http://127.20.132.252:38255/ using document root <none> and password file <none>
I20260811 14:26:05.967824 28583 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:05.967864 28583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:05.968771 28583 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:05.969383 28717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:05.969497 28583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:05.969534 28583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
uuid: "48b918eb5fee461b913b5257aaaea7c6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "3355d82c04735b5bf967b18eae798a18"
server_key_iv: "610bebfd71a445ccd66c043effe00e7f"
server_key_version: "encryptionkey@0"
I20260811 14:26:05.969594 28583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:06.012969 28583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:06.015061 28583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:06.019629 28583 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.252:38777
I20260811 14:26:06.019742 28775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.252:38777 every 8 connection(s)
I20260811 14:26:06.020008 28583 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
I20260811 14:26:06.020973 28776 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:26:06.021586 28776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Bootstrap starting.
I20260811 14:26:06.024747 28776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:26:06.025067 28776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Bootstrap complete.
I20260811 14:26:06.025334 28776 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } }
I20260811 14:26:06.025502 28776 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 48b918eb5fee461b913b5257aaaea7c6, State: Initialized, Role: LEARNER
I20260811 14:26:06.025580 28776 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } }
I20260811 14:26:06.025835 28776 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:06.025857 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:06.025996 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:26:06.027495 28793 catalog_manager.cc:1259] Loaded cluster ID: 1835bd7f53b94c99ba50a90c0af5e704
I20260811 14:26:06.027534 28793 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: loading cluster ID for follower catalog manager: success
W20260811 14:26:06.027370 28690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:06.027614 28690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:06.027664 28690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 14:26:06.028820 28793 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: acquiring CA information for follower catalog manager: success
I20260811 14:26:06.029114 28793 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 14:26:06.029354 28690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:06.029397 28690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:06.029425 28690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:06.031142 28690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:46793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=44997
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:06.031412 28690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:06.031673 28690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:06.037497 28796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:06.037487 28799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:06.037488 28797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:06.038185 28690 server_base.cc:1034] running on GCE node
I20260811 14:26:06.038425 28690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:06.038671 28690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:06.039835 28690 hybrid_clock.cc:648] HybridClock initialized: now 1786458366039815 us; error 38 us; skew 500 ppm
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:06.042469 28690 init.cc:377] Logged in from keytab as oryx/127.20.132.193@KRBTEST.COM (short username oryx)
I20260811 14:26:06.042958 28690 webserver.cc:460] Webserver started at http://127.20.132.193:44997/ using document root <none> and password file <none>
I20260811 14:26:06.043206 28690 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:06.043303 28690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:06.044914 28690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 14:26:06.045513 28809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.045681 28690 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:06.045782 28690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "48ea683de86a4401bbb38baa661be658"
format_stamp: "Formatted at 2026-08-11 14:26:04 on dist-test-slave-cbbz"
server_key: "afd5088187642d3661b579fcfd79561c"
server_key_iv: "bcf93504bf949347c91e031b1b141755"
server_key_version: "encryptionkey@0"
I20260811 14:26:06.046150 28690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:06.063874 28690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:06.065829 28690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:06.066000 28690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:06.066241 28690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:06.066560 28690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:06.066617 28690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.066658 28690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:06.066687 28690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.073357 28690 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:46793
I20260811 14:26:06.073403 28940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:46793 every 8 connection(s)
I20260811 14:26:06.073802 28690 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:06.077288 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 28690
I20260811 14:26:06.077442 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 28065
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.252@KRBTEST.COM
I20260811 14:26:06.085875 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:46529
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:46271
--webserver_port=45173
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:26:06.087031 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.074786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:55293 (local address 127.20.132.253:43551)
0811 14:26:06.074836 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.074838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.075022 (+ 184us) server_negotiation.cc:407] Connection header received
0811 14:26:06.075962 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.075963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.075976 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.076010 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.076828 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.077647 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079176 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.079479 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079521 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.083335 (+ 3814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.083337 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.083337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.083346 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.085337 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.085860 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.085862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.085862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.085927 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086221 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.086222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.086222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.086384 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.086429 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.086833 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.086916 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:26:06.087613 28947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.074491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.20.132.193:55293)
0811 14:26:06.074898 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.074922 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.075855 (+ 933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.076122 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.076126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.076566 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.076711 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.076716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.077874 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.077875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.079063 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.079066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.079617 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079617 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.079774 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.080549 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.080555 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.083216 (+ 2661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.085434 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.085442 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.085444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.085761 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.086009 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.086010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.086143 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.086481 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.086488 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.086669 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.087185 (+ 516us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.087361 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":95,"thread_start_us":81,"threads_started":1}
I20260811 14:26:06.087690 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.074662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:60595 (local address 127.20.132.254:46271)
0811 14:26:06.074711 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.074713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.075175 (+ 462us) server_negotiation.cc:407] Connection header received
0811 14:26:06.075961 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.075963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.075976 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.076010 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.076829 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.077642 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079185 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.079479 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079521 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.083664 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.083666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.083666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.083675 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.086141 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086704 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.086705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.086706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.086766 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.087041 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.087042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.087043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.087185 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.087229 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.087475 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.087569 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 14:26:06.088063 28946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.074491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:60595)
0811 14:26:06.075089 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.075098 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.075858 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.076122 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.076126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.076534 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.076711 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.076714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.077784 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.077785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.079063 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.079066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.079615 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.079774 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.080673 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.080679 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.083584 (+ 2905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.086234 (+ 2650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086234 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.086235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.086618 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.086840 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086841 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.086841 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.086967 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.087289 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.087290 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.087337 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.087811 (+ 474us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.087933 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":57,"thread_start_us":95,"threads_started":1}
I20260811 14:26:06.088455 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.074786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:43881 (local address 127.20.132.252:38777)
0811 14:26:06.075240 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.075242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.075250 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:06.075955 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.075956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.075972 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.076039 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.076830 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.077857 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079164 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.079521 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079580 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.084021 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.084022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.084023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.084031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.086198 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086697 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.086698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.086698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.086767 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086983 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.086984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.086984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.087440 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.087511 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.088218 (+ 707us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.088345 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":57,"threads_started":1}
I20260811 14:26:06.088495 28942 heartbeater.cc:347] Connected to a master server at 127.20.132.254:46271
I20260811 14:26:06.088593 28942 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.088786 28942 heartbeater.cc:511] Master 127.20.132.254:46271 requested a full tablet report, sending...
I20260811 14:26:06.088958 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.074491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.20.132.193:43881)
0811 14:26:06.074871 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.074914 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.075837 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.076121 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.076125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.076524 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.076709 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.076714 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.077958 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.077959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.079065 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.079068 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.079636 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.079637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.079774 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.080528 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.080538 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.083923 (+ 3385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.086280 (+ 2357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086281 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.086281 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.086618 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.086838 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.086839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.086839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.086914 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.087539 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.087540 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.087579 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.087645 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.088708 (+ 1063us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260811 14:26:06.089005 28943 heartbeater.cc:347] Connected to a master server at 127.20.132.253:43551
I20260811 14:26:06.089040 28943 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.089107 28943 heartbeater.cc:511] Master 127.20.132.253:43551 requested a full tablet report, sending...
I20260811 14:26:06.089358 28941 heartbeater.cc:347] Connected to a master server at 127.20.132.252:38777
I20260811 14:26:06.089449 28941 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.089502 28516 ts_manager.cc:194] Registered new tserver with Master: 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793)
I20260811 14:26:06.089596 28941 heartbeater.cc:511] Master 127.20.132.252:38777 requested a full tablet report, sending...
I20260811 14:26:06.089833 27841 ts_manager.cc:194] Re-registered known tserver with Master: 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793)
I20260811 14:26:06.090046 28735 ts_manager.cc:194] Registered new tserver with Master: 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793)
I20260811 14:26:06.090287 27841 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:60595
W20260811 14:26:06.171479 28950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:06.171726 28950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:06.171775 28950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:06.172971 28950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:06.173035 28950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:06.173082 28950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:06.174609 28950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:46529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=45173
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:06.174888 28950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:06.175129 28950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:26:06.180351 28950 server_base.cc:1034] running on GCE node
W20260811 14:26:06.180311 28959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:06.180299 28956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:06.180297 28955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:06.180795 28950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:06.180996 28950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:06.182156 28950 hybrid_clock.cc:648] HybridClock initialized: now 1786458366182142 us; error 31 us; skew 500 ppm
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:06.184716 28950 init.cc:377] Logged in from keytab as oryx/127.20.132.194@KRBTEST.COM (short username oryx)
I20260811 14:26:06.185194 28950 webserver.cc:460] Webserver started at http://127.20.132.194:45173/ using document root <none> and password file <none>
I20260811 14:26:06.185429 28950 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:06.185509 28950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:06.186928 28950 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:06.187549 28968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.187747 28950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:26:06.187870 28950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "550d6987e48b415884bcfd20beb7b0b6"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "1296195b9133884bc844b37243987674"
server_key_iv: "7abb5779f0b51a200267a86b60f05b7e"
server_key_version: "encryptionkey@0"
I20260811 14:26:06.188306 28950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:06.200415 28950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:06.202919 28950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:06.203076 28950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:06.203325 28950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:06.203657 28950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:06.203713 28950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.203749 28950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:06.203807 28950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.209846 28950 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:46529
I20260811 14:26:06.209933 29100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:46529 every 8 connection(s)
I20260811 14:26:06.210292 28950 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:06.211983 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 28950
I20260811 14:26:06.212188 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 28214
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.252@KRBTEST.COM
I20260811 14:26:06.225473 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.211401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:57165 (local address 127.20.132.253:43551)
0811 14:26:06.211446 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.211448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.213408 (+ 1960us) server_negotiation.cc:407] Connection header received
0811 14:26:06.213508 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.213510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.213524 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.213584 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.214700 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.215679 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.217727 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.218026 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.218075 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.221783 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.221785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.221785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.221794 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.223604 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.224308 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.224309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.224310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.224373 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.224642 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.224643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.224644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.224806 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.224858 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.225222 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.225324 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:26:06.226107 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.211055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.20.132.194:57165)
0811 14:26:06.213358 (+ 2303us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.213368 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.213433 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.213721 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.213725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.214313 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.214585 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.214592 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.215831 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.215832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.217622 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.217625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.218182 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.218184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.218333 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.219428 (+ 1095us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.219440 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.221636 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.223692 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.223700 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.223702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.224217 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.224437 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.224438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.224439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.224575 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.224892 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.224899 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.225073 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.225575 (+ 502us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.225795 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2273,"mutex_wait_us":2,"thread_start_us":127,"threads_started":1}
I20260811 14:26:06.227020 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.211389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:39181 (local address 127.20.132.254:46271)
0811 14:26:06.211434 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.211437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.211663 (+ 226us) server_negotiation.cc:407] Connection header received
0811 14:26:06.217658 (+ 5995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.217660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.217676 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.217761 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.218250 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.218953 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.219888 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.220234 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.220292 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.223064 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.223066 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.223066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.223087 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.225126 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.225957 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.225959 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.225959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.226023 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.226259 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.226260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.226261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.226468 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.226517 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.226771 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.226888 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:26:06.227376 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.211056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:39181)
0811 14:26:06.211523 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.211567 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.213175 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.217913 (+ 4738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.217914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.218079 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.218147 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.218148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.219038 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.219039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.219788 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.219790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.220376 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.220377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.220453 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.221314 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.221320 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.222951 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.225501 (+ 2550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.225502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.225502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.225798 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.226098 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.226098 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.226099 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.226178 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.226561 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.226562 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.226601 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.227158 (+ 557us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.227261 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":113,"threads_started":1}
I20260811 14:26:06.227777 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.211164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:52287 (local address 127.20.132.252:38777)
0811 14:26:06.211371 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.211373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.213612 (+ 2239us) server_negotiation.cc:407] Connection header received
0811 14:26:06.213744 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.213746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.213760 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.213793 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.217900 (+ 4107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.218684 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.219943 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.220321 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.220361 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.224409 (+ 4048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.224410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.224411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.224419 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.226142 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.226812 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.226813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.226814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.226883 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.227089 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.227090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.227091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.227235 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.227289 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.227514 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.227622 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260811 14:26:06.228014 29102 heartbeater.cc:347] Connected to a master server at 127.20.132.254:46271
I20260811 14:26:06.228125 29102 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.228325 29103 heartbeater.cc:347] Connected to a master server at 127.20.132.253:43551
I20260811 14:26:06.228379 29102 heartbeater.cc:511] Master 127.20.132.254:46271 requested a full tablet report, sending...
I20260811 14:26:06.228403 29103 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.228483 29103 heartbeater.cc:511] Master 127.20.132.253:43551 requested a full tablet report, sending...
I20260811 14:26:06.228598 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:45525
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:46271
--webserver_port=46121
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:26:06.228876 27841 ts_manager.cc:194] Re-registered known tserver with Master: 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529)
I20260811 14:26:06.228916 28516 ts_manager.cc:194] Registered new tserver with Master: 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529)
I20260811 14:26:06.229383 27841 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:39181
I20260811 14:26:06.230307 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.211056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.20.132.194:52287)
0811 14:26:06.213550 (+ 2494us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.213560 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.213656 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.213871 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.213890 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.217658 (+ 3768us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.217793 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.217795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.218785 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.218785 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.219849 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.219851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.220430 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.220430 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.220493 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.222548 (+ 2055us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.222553 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.224291 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.226472 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.226473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.226473 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.226711 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.226956 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.226957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.226957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.227019 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.227321 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.227321 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.227361 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.227462 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.230172 (+ 2710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2456,"mutex_wait_us":38,"thread_start_us":102,"threads_started":1}
I20260811 14:26:06.230679 29101 heartbeater.cc:347] Connected to a master server at 127.20.132.252:38777
I20260811 14:26:06.230736 29101 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.230816 29101 heartbeater.cc:511] Master 127.20.132.252:38777 requested a full tablet report, sending...
I20260811 14:26:06.231108 28735 ts_manager.cc:194] Registered new tserver with Master: 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529)
W20260811 14:26:06.311233 29108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:06.311470 29108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:06.311507 29108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:06.313539 29108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:06.313602 29108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:06.313647 29108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:06.315227 29108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:45525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=46121
--tserver_master_addrs=127.20.132.254:46271,127.20.132.253:43551,127.20.132.252:38777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:06.315493 29108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:06.315754 29108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:06.320785 29115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:06.320818 29117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:06.320909 29108 server_base.cc:1034] running on GCE node
W20260811 14:26:06.320849 29114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:06.321192 29108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:06.321434 29108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:06.322599 29108 hybrid_clock.cc:648] HybridClock initialized: now 1786458366322590 us; error 38 us; skew 500 ppm
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:06.325045 29108 init.cc:377] Logged in from keytab as oryx/127.20.132.195@KRBTEST.COM (short username oryx)
I20260811 14:26:06.325472 29108 webserver.cc:460] Webserver started at http://127.20.132.195:46121/ using document root <none> and password file <none>
I20260811 14:26:06.325699 29108 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:06.325755 29108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:06.327263 29108 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:26:06.327904 29125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.328155 29108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:06.328269 29108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "191830b8fc8c45f89e22d58b1afa25c9"
format_stamp: "Formatted at 2026-08-11 14:26:05 on dist-test-slave-cbbz"
server_key: "8e26a588483626557c31a6be74090ffd"
server_key_iv: "189380db97064e3224bc06cf9f0355ab"
server_key_version: "encryptionkey@0"
I20260811 14:26:06.328608 29108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:06.342243 29108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:06.344298 29108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:06.344487 29108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:06.344770 29108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:06.345112 29108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:06.345180 29108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.345223 29108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:06.345250 29108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:06.351727 29108 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:45525
I20260811 14:26:06.351825 29257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:45525 every 8 connection(s)
I20260811 14:26:06.352247 29108 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:06.354467 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 29108
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.253@KRBTEST.COM
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
Aug 11 14:26:06 dist-test-slave-cbbz krb5kdc[27791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458366, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.252@KRBTEST.COM
I20260811 14:26:06.364717 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.356467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33572 (local address 127.20.132.252:38777)
0811 14:26:06.356715 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.356717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.356890 (+ 173us) server_negotiation.cc:407] Connection header received
0811 14:26:06.356910 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.356910 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.356921 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.356970 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.357753 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.358476 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.359443 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.359737 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.360085 (+ 348us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.361300 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.361301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.361302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.361309 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.363173 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.363581 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.363582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.363582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.363642 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.363867 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.363867 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.363868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.364016 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.364457 (+ 441us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.364502 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.364592 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":45,"threads_started":1}
I20260811 14:26:06.365350 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.353305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47943 (local address 127.20.132.253:43551)
0811 14:26:06.353361 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.353364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.353598 (+ 234us) server_negotiation.cc:407] Connection header received
0811 14:26:06.354111 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.354112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.354127 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.354163 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.355209 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.355984 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357245 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.357550 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357606 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.361805 (+ 4199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.361824 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.361825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.361832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.363608 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364110 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.364111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.364112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.364239 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364523 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.364523 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.364524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.364658 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.364721 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.365137 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.365219 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 14:26:06.365721 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.353111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:59001 (local address 127.20.132.254:46271)
0811 14:26:06.353180 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.353183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.353578 (+ 395us) server_negotiation.cc:407] Connection header received
0811 14:26:06.354082 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.354084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.354098 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.354167 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.355225 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.355785 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357255 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.357550 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357593 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.361349 (+ 3756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.361350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.361351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.361358 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.364037 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364435 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.364436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.364436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.364520 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364738 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.364738 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.364739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.364868 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.364927 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.365514 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.365616 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:26:06.365909 29266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.353054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:59001)
0811 14:26:06.353406 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.353452 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.353979 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.354232 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.354237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.354782 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.355098 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.355105 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.355897 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.355897 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.357144 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.357146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.357688 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.357824 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.358598 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.358608 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.361243 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.364120 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364121 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.364121 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.364358 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.364609 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364609 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.364610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.364669 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.364954 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.364955 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.364995 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.365062 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.365235 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":8,"thread_start_us":89,"threads_started":1}
I20260811 14:26:06.366319 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.353054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.20.132.195:47943)
0811 14:26:06.353436 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.353455 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.354003 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.354240 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.354241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.354782 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.355096 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.355102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.356089 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.356090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.357144 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.357146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.357667 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.357824 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.358638 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.358642 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.361696 (+ 3054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.363701 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.363708 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.363711 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.364021 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.364317 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.364318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.364318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.364452 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.364748 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.364755 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.364930 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.365031 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.366213 (+ 1182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":1326,"thread_start_us":72,"threads_started":1}
I20260811 14:26:06.366662 29261 heartbeater.cc:347] Connected to a master server at 127.20.132.253:43551
I20260811 14:26:06.366760 29261 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.366803 29260 heartbeater.cc:347] Connected to a master server at 127.20.132.254:46271
I20260811 14:26:06.366861 29260 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.366983 29261 heartbeater.cc:511] Master 127.20.132.253:43551 requested a full tablet report, sending...
I20260811 14:26:06.366982 29260 heartbeater.cc:511] Master 127.20.132.254:46271 requested a full tablet report, sending...
I20260811 14:26:06.367458 28516 ts_manager.cc:194] Registered new tserver with Master: 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195:45525)
I20260811 14:26:06.367986 27841 ts_manager.cc:194] Re-registered known tserver with Master: 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195:45525)
I20260811 14:26:06.368551 27841 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:59001
I20260811 14:26:06.369297 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.353172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:33037 (local address 127.20.132.252:38777)
0811 14:26:06.353220 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.353222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.353555 (+ 333us) server_negotiation.cc:407] Connection header received
0811 14:26:06.354118 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.354120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.354132 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.354165 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.355210 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.355979 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357248 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.357586 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357630 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.365057 (+ 7427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.365058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.365058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.365065 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.367700 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.368294 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.368295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.368296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.368394 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.368688 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.368689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.368690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.368818 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.368896 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.369132 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.369214 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 14:26:06.369839 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.353054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.20.132.195:33037)
0811 14:26:06.353406 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.353453 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.354002 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.354642 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.354642 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.354819 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:06.355102 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.355104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.356089 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.356090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.357147 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.357151 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.357716 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.357716 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.357824 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.358701 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:06.358706 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:06.364718 (+ 6012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:06.367783 (+ 3065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.367784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.367785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.368206 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.368468 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:06.368469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:06.368469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:06.368559 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:06.368952 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:06.368953 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:06.368991 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.369565 (+ 574us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.369691 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":85,"thread_start_us":76,"threads_started":1}
I20260811 14:26:06.370558 29258 heartbeater.cc:347] Connected to a master server at 127.20.132.252:38777
I20260811 14:26:06.370617 29258 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:06.370692 29258 heartbeater.cc:511] Master 127.20.132.252:38777 requested a full tablet report, sending...
I20260811 14:26:06.371002 28735 ts_manager.cc:194] Registered new tserver with Master: 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195:45525)
I20260811 14:26:06.371253 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.358237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.20.132.254:46271)
0811 14:26:06.359542 (+ 1305us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.359544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.359550 (+ 6us) server_negotiation.cc:407] Connection header received
0811 14:26:06.359568 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.359569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.359580 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.359652 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.360471 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.361293 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.362371 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.362714 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.362778 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.364331 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.364332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.364332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.364339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.369856 (+ 5517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.370283 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.370284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.370284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.370355 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.370709 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.370711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.370711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.370846 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.370958 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.371054 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.371141 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1279,"thread_start_us":120,"threads_started":1}
I20260811 14:26:06.371512 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.365522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33576)
0811 14:26:06.365600 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.365610 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.365646 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.365887 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.365888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.365890 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:06.365929 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.365931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.368302 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.368303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.369461 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.369464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.371280 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.371281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.371358 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.371363 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.371394 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.371440 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 14:26:06.371925 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.365709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33576 (local address 127.20.132.252:38777)
0811 14:26:06.365745 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.365747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.365754 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:06.365775 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.365776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.365800 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.365993 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:06.366024 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.368200 (+ 2176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.369560 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.370497 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.371684 (+ 1187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.371802 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.371824 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.371869 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:26:06.372237 28748 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 14:26:06.372710 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a65b200ad3f34472807804529267934c. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:06.372807 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:26:06.374310 29277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.358795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37112 (local address 127.20.132.253:43551)
0811 14:26:06.359483 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.359485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.360258 (+ 773us) server_negotiation.cc:407] Connection header received
0811 14:26:06.361631 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.361632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.361645 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.361683 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.367434 (+ 5751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.368200 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.369523 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.369821 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.369862 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.371375 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.371377 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.371377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.371384 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.373179 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.373573 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.373574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.373574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.373638 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.373841 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.373841 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.373841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.373937 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.374005 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.374162 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.374223 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":63,"threads_started":1}
I20260811 14:26:06.373090 27841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:26:06.375301 27841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:06.376111 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: NON_VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: true } } }
I20260811 14:26:06.376273 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:06.377431 28470 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: attempting to promote NON_VOTER 48b918eb5fee461b913b5257aaaea7c6 to VOTER
I20260811 14:26:06.377549 28470 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } }
I20260811 14:26:06.378006 28530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Refusing update from remote peer a65b200ad3f34472807804529267934c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 14:26:06.378036 28748 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 LEARNER]: Refusing update from remote peer a65b200ad3f34472807804529267934c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 14:26:06.378273 28694 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Connected to new peer: Peer: permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 14:26:06.378391 28694 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [LEADER]: Connected to new peer: Peer: permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 14:26:06.379249 28470 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.379524 28748 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.380110 28694 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.380201 28694 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:06.380249 28530 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.380210 28693 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.380370 28693 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:06.380659 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.380740 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:26:06.381300 28692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.381387 28692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:26:06.380086 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a65b200ad3f34472807804529267934c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:06.381578 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:06.385648 29286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.381511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:46529 (local address 127.0.0.1:56638)
0811 14:26:06.381732 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.381745 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.381814 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.382658 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.382659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.382661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:06.382694 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.382695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.383523 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.383524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.384558 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.384560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.385408 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.385409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.385470 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.385474 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.385513 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.385551 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202}
I20260811 14:26:06.385910 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.381579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:46793 (local address 127.0.0.1:54120)
0811 14:26:06.381806 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.381816 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.381865 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.382469 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.382470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.382473 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:06.382522 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.382523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.383787 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.383788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.384839 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.384841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.385715 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.385717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.385778 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.385782 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.385811 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.385849 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":26,"thread_start_us":110,"threads_started":1}
I20260811 14:26:06.385960 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.381920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56638 (local address 127.20.132.194:46529)
0811 14:26:06.382429 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.382433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.382444 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:26:06.382482 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.382484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.382499 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.382664 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:06.382759 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.383433 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.384644 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.385317 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.385446 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.385504 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.385542 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.385580 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":85,"threads_started":1}
I20260811 14:26:06.386307 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.382117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54120 (local address 127.20.132.193:46793)
0811 14:26:06.382287 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.382292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.382304 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:26:06.382345 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.382348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.382365 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.382454 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:06.382587 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.383691 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.384915 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.385615 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.386116 (+ 501us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.386179 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.386204 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.386248 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260811 14:26:06.386683 29025 tablet_service.cc:1467] Processing CreateTablet for tablet ff53a6940c38447caf726e2096dc1bb9 (DEFAULT_TABLE table=test-table [id=cb5deb3c52b542cb8ce7b4a217463230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:06.387140 29025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff53a6940c38447caf726e2096dc1bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:06.387144 28864 tablet_service.cc:1467] Processing CreateTablet for tablet ff53a6940c38447caf726e2096dc1bb9 (DEFAULT_TABLE table=test-table [id=cb5deb3c52b542cb8ce7b4a217463230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:06.387516 29287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.381625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:45525 (local address 127.0.0.1:48514)
0811 14:26:06.382451 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.382463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.382511 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.382756 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.382757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.382759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:06.382799 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.382801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.383963 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.383964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.385565 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.385567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.387237 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.387238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.387300 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.387324 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.387388 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.387430 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"thread_start_us":95,"threads_started":1}
I20260811 14:26:06.387511 28864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff53a6940c38447caf726e2096dc1bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:06.387559 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.382024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48514 (local address 127.20.132.195:45525)
0811 14:26:06.382227 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.382231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.382568 (+ 337us) server_negotiation.cc:407] Connection header received
0811 14:26:06.382609 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.382611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.382627 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.382697 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:06.382872 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.383879 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.385665 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.387116 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.387220 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.387273 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.387414 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.387455 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":120,"threads_started":1}
I20260811 14:26:06.388370 29183 tablet_service.cc:1467] Processing CreateTablet for tablet ff53a6940c38447caf726e2096dc1bb9 (DEFAULT_TABLE table=test-table [id=cb5deb3c52b542cb8ce7b4a217463230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:06.388716 29183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff53a6940c38447caf726e2096dc1bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:06.390497 29292 tablet_bootstrap.cc:492] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Bootstrap starting.
I20260811 14:26:06.391058 29293 tablet_bootstrap.cc:492] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Bootstrap starting.
I20260811 14:26:06.391326 29292 tablet_bootstrap.cc:654] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:06.391695 29292 log.cc:824] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:06.391757 29293 tablet_bootstrap.cc:654] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:06.392100 29293 log.cc:824] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:06.392169 29297 tablet_bootstrap.cc:492] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Bootstrap starting.
I20260811 14:26:06.392637 29292 tablet_bootstrap.cc:492] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: No bootstrap required, opened a new log
I20260811 14:26:06.392729 29292 ts_tablet_manager.cc:1397] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:26:06.392795 29297 tablet_bootstrap.cc:654] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:06.393113 29297 log.cc:824] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:06.393944 29297 tablet_bootstrap.cc:492] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: No bootstrap required, opened a new log
I20260811 14:26:06.393981 29293 tablet_bootstrap.cc:492] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: No bootstrap required, opened a new log
I20260811 14:26:06.394009 29297 ts_tablet_manager.cc:1397] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:26:06.394052 29293 ts_tablet_manager.cc:1397] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 14:26:06.394625 29292 raft_consensus.cc:348] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.394791 29292 raft_consensus.cc:374] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:06.394825 29292 raft_consensus.cc:729] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 550d6987e48b415884bcfd20beb7b0b6, State: Initialized, Role: FOLLOWER
I20260811 14:26:06.394944 29292 consensus_queue.cc:260] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.395218 29292 ts_tablet_manager.cc:1428] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 14:26:06.396207 29102 heartbeater.cc:503] Master 127.20.132.254:46271 was elected leader, sending a full tablet report...
I20260811 14:26:06.396081 29293 raft_consensus.cc:348] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.396267 29293 raft_consensus.cc:374] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:06.396311 29293 raft_consensus.cc:729] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48ea683de86a4401bbb38baa661be658, State: Initialized, Role: FOLLOWER
I20260811 14:26:06.396422 29293 consensus_queue.cc:260] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.396456 29297 raft_consensus.cc:348] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.396601 29297 raft_consensus.cc:374] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:06.396646 29297 raft_consensus.cc:729] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191830b8fc8c45f89e22d58b1afa25c9, State: Initialized, Role: FOLLOWER
I20260811 14:26:06.396683 29293 ts_tablet_manager.cc:1428] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:26:06.396770 29297 consensus_queue.cc:260] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.396817 28942 heartbeater.cc:503] Master 127.20.132.254:46271 was elected leader, sending a full tablet report...
I20260811 14:26:06.397672 29297 ts_tablet_manager.cc:1428] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 14:26:06.397997 29260 heartbeater.cc:503] Master 127.20.132.254:46271 was elected leader, sending a full tablet report...
W20260811 14:26:06.461560 29104 tablet.cc:2369] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:26:06.505453 29305 raft_consensus.cc:482] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:06.505647 29305 raft_consensus.cc:504] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.506070 29305 leader_election.cc:288] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529), 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793)
I20260811 14:26:06.509138 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.506497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47243 (local address 127.20.132.194:46529)
0811 14:26:06.506556 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.506558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.506566 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:06.506594 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.506595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.506604 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.506660 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:06.506848 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.507394 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.508394 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.508768 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.508854 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.508864 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.509018 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.509064 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:26:06.509184 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.506293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:46529 (local address 127.20.132.195:47243)
0811 14:26:06.506410 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.506423 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.506475 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.506684 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.506685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.506686 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:06.506762 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.506763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.507479 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.507480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.508284 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.508286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.508854 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.508855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.508938 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.508941 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.509010 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.509058 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":18}
I20260811 14:26:06.509188 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.506388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47141 (local address 127.20.132.193:46793)
0811 14:26:06.506444 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.506446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.506457 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:26:06.506523 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.506524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.506536 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.506594 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:06.506783 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.507293 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.508443 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.508814 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.508901 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.508909 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.509072 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.509126 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 14:26:06.509189 29266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.506281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:46793 (local address 127.20.132.195:47141)
0811 14:26:06.506399 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:06.506413 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:06.506460 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:06.506610 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:06.506611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:06.506613 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:06.506695 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.506697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.507370 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.507371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.508348 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:06.508351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.508898 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.508899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:06.508987 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.508990 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:06.509062 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 14:26:06.509103 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":64}
I20260811 14:26:06.509618 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff53a6940c38447caf726e2096dc1bb9" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48ea683de86a4401bbb38baa661be658" is_pre_election: true
I20260811 14:26:06.509781 28887 raft_consensus.cc:2454] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 0.
I20260811 14:26:06.509958 29050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff53a6940c38447caf726e2096dc1bb9" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550d6987e48b415884bcfd20beb7b0b6" is_pre_election: true
I20260811 14:26:06.510007 29127 leader_election.cc:302] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191830b8fc8c45f89e22d58b1afa25c9, 48ea683de86a4401bbb38baa661be658; no voters:
I20260811 14:26:06.510106 29050 raft_consensus.cc:2454] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 0.
I20260811 14:26:06.510154 29305 raft_consensus.cc:2781] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:06.510272 29305 raft_consensus.cc:482] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:06.510305 29305 raft_consensus.cc:3037] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:06.511025 29305 raft_consensus.cc:504] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.511186 29305 leader_election.cc:288] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 election: Requested vote from peers 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529), 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793)
I20260811 14:26:06.511336 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff53a6940c38447caf726e2096dc1bb9" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48ea683de86a4401bbb38baa661be658"
I20260811 14:26:06.511337 29050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff53a6940c38447caf726e2096dc1bb9" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550d6987e48b415884bcfd20beb7b0b6"
I20260811 14:26:06.511413 28887 raft_consensus.cc:3037] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:06.511413 29050 raft_consensus.cc:3037] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:06.512322 29050 raft_consensus.cc:2454] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 1.
I20260811 14:26:06.512322 28887 raft_consensus.cc:2454] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 1.
I20260811 14:26:06.512516 29127 leader_election.cc:302] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191830b8fc8c45f89e22d58b1afa25c9, 48ea683de86a4401bbb38baa661be658; no voters:
I20260811 14:26:06.512632 29305 raft_consensus.cc:2781] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:06.512799 29305 raft_consensus.cc:686] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 LEADER]: Becoming Leader. State: Replica: 191830b8fc8c45f89e22d58b1afa25c9, State: Running, Role: LEADER
I20260811 14:26:06.512897 29305 consensus_queue.cc:237] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } }
I20260811 14:26:06.513756 27841 catalog_manager.cc:5495] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "191830b8fc8c45f89e22d58b1afa25c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260811 14:26:06.529390 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.526964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48528 (local address 127.20.132.195:45525)
0811 14:26:06.527019 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.527021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.527031 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:06.527090 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.527091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.527111 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.527186 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:06.527301 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.527844 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.528626 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.528816 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.528869 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.528995 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:06.529090 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:06.529152 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.529253 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.529272 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 14:26:06.531219 28887 raft_consensus.cc:1261] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Refusing update from remote peer 191830b8fc8c45f89e22d58b1afa25c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:06.531232 29050 raft_consensus.cc:1261] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Refusing update from remote peer 191830b8fc8c45f89e22d58b1afa25c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:06.531600 29305 consensus_queue.cc:1035] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:06.531759 29306 consensus_queue.cc:1035] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:06.535149 29311 mvcc.cc:205] Tried to move back new op lower bound from 7317333469309399040 to 7317333469237645312. Current Snapshot: MvccSnapshot[applied={T|T < 7317333469309399040}]
I20260811 14:26:06.535665 29312 mvcc.cc:205] Tried to move back new op lower bound from 7317333469309399040 to 7317333469237645312. Current Snapshot: MvccSnapshot[applied={T|T < 7317333469309399040}]
I20260811 14:26:06.537600 27841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:06.537706 27841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:06.538935 27841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a65b200ad3f34472807804529267934c: Sending DeleteTablet for 3 replicas of tablet ff53a6940c38447caf726e2096dc1bb9
I20260811 14:26:06.539392 29025 tablet_service.cc:1514] Processing DeleteTablet for tablet ff53a6940c38447caf726e2096dc1bb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:06 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:56638
I20260811 14:26:06.539422 29183 tablet_service.cc:1514] Processing DeleteTablet for tablet ff53a6940c38447caf726e2096dc1bb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:06 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:48514
I20260811 14:26:06.539511 28864 tablet_service.cc:1514] Processing DeleteTablet for tablet ff53a6940c38447caf726e2096dc1bb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:06 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:54120
I20260811 14:26:06.540548 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 27806
I20260811 14:26:06.547860 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.539959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33578 (local address 127.20.132.252:38777)
0811 14:26:06.540001 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.540004 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.540224 (+ 220us) server_negotiation.cc:407] Connection header received
0811 14:26:06.540286 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.540287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.540299 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.540359 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.541098 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.541694 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.542526 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.542833 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.542878 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.544693 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.544695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.544695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.544702 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.546517 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.546939 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.546940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.546940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.547000 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.547222 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.547222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.547223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.547359 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.547434 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.547666 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.547764 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:06.550314 29323 tablet_replica.cc:330] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: stopping tablet replica
I20260811 14:26:06.550447 29323 raft_consensus.cc:2229] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:06.550575 29323 raft_consensus.cc:2258] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:06.551142 29323 ts_tablet_manager.cc:1905] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:06.552945 29321 tablet_replica.cc:330] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: stopping tablet replica
I20260811 14:26:06.553068 29321 raft_consensus.cc:2229] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:06.553187 29321 raft_consensus.cc:2258] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:06.553354 29323 ts_tablet_manager.cc:1918] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:06.553427 29323 log.cc:1196] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/ff53a6940c38447caf726e2096dc1bb9
I20260811 14:26:06.553696 29323 ts_tablet_manager.cc:1939] T ff53a6940c38447caf726e2096dc1bb9 P 48ea683de86a4401bbb38baa661be658: Deleting consensus metadata
W20260811 14:26:06.554050 28811 connection.cc:441] server connection from 127.0.0.1:54120 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54120 (request call id 1) could send its response
I20260811 14:26:06.554625 29321 ts_tablet_manager.cc:1905] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:06.556610 29321 ts_tablet_manager.cc:1918] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:06.556691 29321 log.cc:1196] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/ff53a6940c38447caf726e2096dc1bb9
I20260811 14:26:06.556998 29321 ts_tablet_manager.cc:1939] T ff53a6940c38447caf726e2096dc1bb9 P 191830b8fc8c45f89e22d58b1afa25c9: Deleting consensus metadata
I20260811 14:26:06.557432 29322 tablet_replica.cc:330] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: stopping tablet replica
I20260811 14:26:06.557557 29322 raft_consensus.cc:2229] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:06.557675 29322 raft_consensus.cc:2258] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 14:26:06.557812 29130 connection.cc:441] server connection from 127.0.0.1:48514 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48514 (request call id 1) could send its response
I20260811 14:26:06.558331 29322 ts_tablet_manager.cc:1905] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:06.559387 29277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.550701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37118 (local address 127.20.132.253:43551)
0811 14:26:06.550751 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.550754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.551020 (+ 266us) server_negotiation.cc:407] Connection header received
0811 14:26:06.551115 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.551116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.551130 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.551160 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.551919 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.552734 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.554242 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.554561 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.554617 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.556260 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.556262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.556262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.556270 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.557980 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.558521 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.558522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.558522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.558591 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.558793 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.558794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.558794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.558920 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.558995 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.559204 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.559290 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:26:06.560056 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:06.550502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33594 (local address 127.20.132.252:38777)
0811 14:26:06.550542 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:06.550544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:06.550952 (+ 408us) server_negotiation.cc:407] Connection header received
0811 14:26:06.551050 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:06.551051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:06.551061 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:06.551089 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:06.552189 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.552888 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.553971 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:06.554265 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:06.554313 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:06.556357 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:06.556359 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:06.556359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:06.556366 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:06.558751 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.559146 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.559147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.559147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.559204 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:06.559427 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:06.559428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:06.559428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:06.559557 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:06.559638 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:06.559849 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 14:26:06.559926 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:06.560066 29322 ts_tablet_manager.cc:1918] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:06.560166 29322 log.cc:1196] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/ff53a6940c38447caf726e2096dc1bb9
I20260811 14:26:06.560452 29322 ts_tablet_manager.cc:1939] T ff53a6940c38447caf726e2096dc1bb9 P 550d6987e48b415884bcfd20beb7b0b6: Deleting consensus metadata
W20260811 14:26:06.560830 28972 connection.cc:441] server connection from 127.0.0.1:56638 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56638 (request call id 1) could send its response
I20260811 14:26:07.536773 29334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:07.536480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:39487)
0811 14:26:07.536606 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:07.536702 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
W20260811 14:26:07.537030 29102 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:46271 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:07.537323 29335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:07.537091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:38657)
0811 14:26:07.537199 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:07.537273 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":55,"threads_started":1}
I20260811 14:26:07.537503 29336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:07.537284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:56059)
0811 14:26:07.537390 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:07.537459 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":49,"threads_started":1}
W20260811 14:26:07.537554 29260 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:46271 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
W20260811 14:26:07.537703 28942 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:46271 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:08.040124 29337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a65b200ad3f34472807804529267934c)
I20260811 14:26:08.040284 29337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } }
I20260811 14:26:08.040560 29337 leader_election.cc:288] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a65b200ad3f34472807804529267934c (127.20.132.254:46271), 271aacfd18c946b0aec4fefced1729d3 (127.20.132.253:43551)
I20260811 14:26:08.040916 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.040662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34566)
0811 14:26:08.040812 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.040869 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260811 14:26:08.041054 29340 raft_consensus.cc:482] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a65b200ad3f34472807804529267934c)
W20260811 14:26:08.041121 28719 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:08.041167 29340 raft_consensus.cc:504] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } }
I20260811 14:26:08.041805 29340 leader_election.cc:288] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a65b200ad3f34472807804529267934c (127.20.132.254:46271), 48b918eb5fee461b913b5257aaaea7c6 (127.20.132.252:38777)
I20260811 14:26:08.041872 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.041728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34600)
0811 14:26:08.041815 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.041842 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260811 14:26:08.041960 28719 leader_election.cc:334] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a65b200ad3f34472807804529267934c (127.20.132.254:46271): Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:08.042119 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.041491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34594)
0811 14:26:08.041984 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.042083 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":61,"threads_started":1}
W20260811 14:26:08.042335 28499 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:08.042816 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.042706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34606)
0811 14:26:08.042759 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.042791 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 14:26:08.042906 28499 leader_election.cc:334] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a65b200ad3f34472807804529267934c (127.20.132.254:46271): Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:08.044392 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.040746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:43551 (local address 127.0.0.1:37128)
0811 14:26:08.040950 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.040961 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:08.041028 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:08.041390 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:08.041392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:08.041394 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:08.041468 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.041470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.042387 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.042389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.043416 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.043419 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.044120 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.044121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.044226 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.044231 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:26:08.044300 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:26:08.044347 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":47,"threads_started":1}
I20260811 14:26:08.044471 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.040854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37128 (local address 127.20.132.253:43551)
0811 14:26:08.040951 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:08.040953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:08.041087 (+ 134us) server_negotiation.cc:407] Connection header received
0811 14:26:08.041249 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:08.041250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:08.041262 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:08.041328 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:08.041548 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.042316 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.043501 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.044040 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.044117 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.044126 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:08.044336 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 14:26:08.044382 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":43,"threads_started":1}
I20260811 14:26:08.044669 28530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48b918eb5fee461b913b5257aaaea7c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "271aacfd18c946b0aec4fefced1729d3" is_pre_election: true
I20260811 14:26:08.044754 28530 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48b918eb5fee461b913b5257aaaea7c6 in term 1.
I20260811 14:26:08.044914 28720 leader_election.cc:302] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271aacfd18c946b0aec4fefced1729d3, 48b918eb5fee461b913b5257aaaea7c6; no voters: a65b200ad3f34472807804529267934c
I20260811 14:26:08.045017 29337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 14:26:08.045077 29337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a65b200ad3f34472807804529267934c)
I20260811 14:26:08.045112 29337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:26:08.045485 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.041702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:38777 (local address 127.0.0.1:33604)
0811 14:26:08.042073 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.042086 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:08.042144 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:08.042302 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:08.042303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:08.042304 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:08.042347 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.042348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.043223 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.043224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.044369 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.044371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.045247 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.045248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.045317 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.045321 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:08.045386 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 14:26:08.045424 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":52,"threads_started":1}
I20260811 14:26:08.045516 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.042033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33604 (local address 127.20.132.252:38777)
0811 14:26:08.042169 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:08.042171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:08.042180 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:08.042215 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:08.042216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:08.042225 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:08.042295 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:08.042435 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.043113 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.044586 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.045174 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.045243 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.045248 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:08.045397 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 14:26:08.045452 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260811 14:26:08.045796 28748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "271aacfd18c946b0aec4fefced1729d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "48b918eb5fee461b913b5257aaaea7c6" is_pre_election: true
I20260811 14:26:08.046169 29337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } }
I20260811 14:26:08.046269 28748 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 271aacfd18c946b0aec4fefced1729d3 in current term 2: Already voted for candidate 48b918eb5fee461b913b5257aaaea7c6 in this term.
I20260811 14:26:08.046300 29337 leader_election.cc:288] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [CANDIDATE]: Term 2 election: Requested vote from peers a65b200ad3f34472807804529267934c (127.20.132.254:46271), 271aacfd18c946b0aec4fefced1729d3 (127.20.132.253:43551)
I20260811 14:26:08.046494 28498 leader_election.cc:302] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 271aacfd18c946b0aec4fefced1729d3; no voters: 48b918eb5fee461b913b5257aaaea7c6, a65b200ad3f34472807804529267934c
I20260811 14:26:08.046518 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.046429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34616)
0811 14:26:08.046463 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.046492 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 14:26:08.046692 29340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:26:08.046694 28530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48b918eb5fee461b913b5257aaaea7c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "271aacfd18c946b0aec4fefced1729d3"
I20260811 14:26:08.046839 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.046749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34624)
0811 14:26:08.046797 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.046820 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:26:08.046916 28719 leader_election.cc:334] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a65b200ad3f34472807804529267934c (127.20.132.254:46271): Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
I20260811 14:26:08.047380 29340 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:26:08.048121 28530 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48b918eb5fee461b913b5257aaaea7c6 in term 2.
I20260811 14:26:08.048377 28720 leader_election.cc:302] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 271aacfd18c946b0aec4fefced1729d3, 48b918eb5fee461b913b5257aaaea7c6; no voters: a65b200ad3f34472807804529267934c
I20260811 14:26:08.048466 29337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:26:08.048614 29337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [term 2 LEADER]: Becoming Leader. State: Replica: 48b918eb5fee461b913b5257aaaea7c6, State: Running, Role: LEADER
I20260811 14:26:08.048707 29337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } }
I20260811 14:26:08.049091 29348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48b918eb5fee461b913b5257aaaea7c6. Latest consensus state: current_term: 2 leader_uuid: "48b918eb5fee461b913b5257aaaea7c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:08.049192 29348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:08.049397 29350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:08.049927 29350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:08.050096 29350 catalog_manager.cc:1259] Loaded cluster ID: 1835bd7f53b94c99ba50a90c0af5e704
I20260811 14:26:08.050148 29350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:08.050354 29350 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:08.050459 29350 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Loaded TSK: 0
I20260811 14:26:08.050606 29350 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:26:08.096727 28733 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:26:08.098310 28733 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:08.099334 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.099208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34630)
0811 14:26:08.099266 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.099302 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 14:26:08.099339 28530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [term 2 FOLLOWER]: Refusing update from remote peer 48b918eb5fee461b913b5257aaaea7c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 14:26:08.099620 29348 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 14:26:08.099779 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.099650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.0.0.1:34638)
0811 14:26:08.099702 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.099733 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 14:26:08.099867 28719 consensus_peers.cc:487] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 -> Peer a65b200ad3f34472807804529267934c (127.20.132.254:46271): Couldn't send request to peer a65b200ad3f34472807804529267934c. Status: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 14:26:08.100350 29340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48b918eb5fee461b913b5257aaaea7c6. Latest consensus state: current_term: 2 leader_uuid: "48b918eb5fee461b913b5257aaaea7c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:08.100476 29340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:26:08.100884 29337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "48b918eb5fee461b913b5257aaaea7c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:08.100972 29337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:08.101300 29352 mvcc.cc:205] Tried to move back new op lower bound from 7317333475732926464 to 7317333475528273920. Current Snapshot: MvccSnapshot[applied={T|T < 7317333475732926464}]
I20260811 14:26:08.101405 29340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "48b918eb5fee461b913b5257aaaea7c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a65b200ad3f34472807804529267934c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46271 } } peers { permanent_uuid: "271aacfd18c946b0aec4fefced1729d3" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 43551 } attrs { promote: false } } peers { permanent_uuid: "48b918eb5fee461b913b5257aaaea7c6" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 38777 } attrs { promote: false } } }
I20260811 14:26:08.101488 29340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271aacfd18c946b0aec4fefced1729d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:26:08.106179 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.102642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:46793 (local address 127.0.0.1:54136)
0811 14:26:08.102692 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.102704 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:08.102745 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:08.103468 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:08.103469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:08.103471 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:08.103506 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.103507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.104395 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.104396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.105181 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.105183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.105959 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.105960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.106025 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.106032 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 14:26:08.106082 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 14:26:08.106120 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":24}
I20260811 14:26:08.106317 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.102726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:46529 (local address 127.0.0.1:56642)
0811 14:26:08.102798 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.102811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:08.102867 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:08.103118 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:08.103119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:08.103122 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:08.103191 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.103193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.104215 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.104216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.105323 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.105326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.106052 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.106053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.106117 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.106121 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:08.106205 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:26:08.106250 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":6}
I20260811 14:26:08.106324 29359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.102797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.20.132.194:46529)
0811 14:26:08.102959 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:08.102962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:08.102971 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:08.103000 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:08.103000 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:08.103015 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:08.103266 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:08.103311 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.104094 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.105408 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.105984 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.106051 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.106060 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:08.106215 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 14:26:08.106259 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260811 14:26:08.106496 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.103054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54136 (local address 127.20.132.193:46793)
0811 14:26:08.103335 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:08.103338 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:08.103346 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:08.103371 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:08.103371 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:08.103382 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:08.103562 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:08.103599 (+ 37us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.104310 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.105266 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.105872 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.105951 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.105961 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:08.106362 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 14:26:08.106412 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":57,"threads_started":1}
I20260811 14:26:08.106546 29025 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee5dfdb9867496283a212527adb9924 (DEFAULT_TABLE table=test-table [id=b8ffe9f5475d490a91f065ea90184112]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:08.106688 29025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee5dfdb9867496283a212527adb9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:08.106719 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.102904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:45525 (local address 127.0.0.1:48542)
0811 14:26:08.103104 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.103114 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:08.103157 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:08.103449 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:08.103450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:08.103452 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:08.103498 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.103499 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.104103 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.104104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.105328 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:08.105329 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.106480 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.106481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:08.106539 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.106542 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:08.106591 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:26:08.106633 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":27,"thread_start_us":89,"threads_started":1}
I20260811 14:26:08.106914 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.103208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48542 (local address 127.20.132.195:45525)
0811 14:26:08.103326 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:08.103328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:08.103334 (+ 6us) server_negotiation.cc:407] Connection header received
0811 14:26:08.103355 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:08.103356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:08.103365 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:08.103447 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:08.103553 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.104021 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.105447 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.105978 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.106052 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.106061 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:08.106802 (+ 741us) server_negotiation.cc:299] Negotiation successful
0811 14:26:08.106850 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":65,"threads_started":1}
I20260811 14:26:08.107103 29183 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee5dfdb9867496283a212527adb9924 (DEFAULT_TABLE table=test-table [id=b8ffe9f5475d490a91f065ea90184112]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:08.107262 29183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee5dfdb9867496283a212527adb9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:08.108183 29364 tablet_bootstrap.cc:492] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Bootstrap starting.
I20260811 14:26:08.108250 28864 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee5dfdb9867496283a212527adb9924 (DEFAULT_TABLE table=test-table [id=b8ffe9f5475d490a91f065ea90184112]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:08.108381 28864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee5dfdb9867496283a212527adb9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:08.108620 29364 tablet_bootstrap.cc:654] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:08.108759 29365 tablet_bootstrap.cc:492] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Bootstrap starting.
I20260811 14:26:08.109210 29365 tablet_bootstrap.cc:654] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:08.109315 29364 tablet_bootstrap.cc:492] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: No bootstrap required, opened a new log
I20260811 14:26:08.109378 29364 ts_tablet_manager.cc:1397] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:08.109489 29364 raft_consensus.cc:348] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.109553 29364 raft_consensus.cc:374] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:08.109571 29364 raft_consensus.cc:729] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 550d6987e48b415884bcfd20beb7b0b6, State: Initialized, Role: FOLLOWER
I20260811 14:26:08.109619 29364 consensus_queue.cc:260] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.109772 29364 ts_tablet_manager.cc:1428] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:08.109915 29365 tablet_bootstrap.cc:492] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: No bootstrap required, opened a new log
I20260811 14:26:08.109975 29365 ts_tablet_manager.cc:1397] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:08.110049 29369 tablet_bootstrap.cc:492] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: Bootstrap starting.
I20260811 14:26:08.110399 29101 heartbeater.cc:503] Master 127.20.132.252:38777 was elected leader, sending a full tablet report...
I20260811 14:26:08.110569 29369 tablet_bootstrap.cc:654] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:08.110502 29365 raft_consensus.cc:348] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.110890 29365 raft_consensus.cc:374] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:08.110925 29365 raft_consensus.cc:729] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191830b8fc8c45f89e22d58b1afa25c9, State: Initialized, Role: FOLLOWER
I20260811 14:26:08.110970 29365 consensus_queue.cc:260] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.111131 29365 ts_tablet_manager.cc:1428] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:08.111338 29371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.110201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:60547)
0811 14:26:08.111256 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.111298 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1028,"thread_start_us":87,"threads_started":1}
I20260811 14:26:08.111428 29369 tablet_bootstrap.cc:492] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: No bootstrap required, opened a new log
I20260811 14:26:08.111469 29369 ts_tablet_manager.cc:1397] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:26:08.111527 29258 heartbeater.cc:503] Master 127.20.132.252:38777 was elected leader, sending a full tablet report...
I20260811 14:26:08.111635 29369 raft_consensus.cc:348] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.111706 29369 raft_consensus.cc:374] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:08.111728 29369 raft_consensus.cc:729] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48ea683de86a4401bbb38baa661be658, State: Initialized, Role: FOLLOWER
I20260811 14:26:08.111732 29371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.111561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:59673)
0811 14:26:08.111668 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.111703 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":69,"threads_started":1}
I20260811 14:26:08.111775 29369 consensus_queue.cc:260] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.111940 29369 ts_tablet_manager.cc:1428] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:08.111969 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.111330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:42207)
0811 14:26:08.111894 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.111933 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":79,"threads_started":1}
I20260811 14:26:08.112417 28941 heartbeater.cc:503] Master 127.20.132.252:38777 was elected leader, sending a full tablet report...
I20260811 14:26:08.112615 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.112521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:50175)
0811 14:26:08.112560 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.112592 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 14:26:08.112687 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.112258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:60999)
0811 14:26:08.112591 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.112627 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":83,"threads_started":1}
I20260811 14:26:08.112985 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.112887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:46923)
0811 14:26:08.112934 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.112958 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:26:08.253741 29373 raft_consensus.cc:482] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:08.253867 29373 raft_consensus.cc:504] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.254058 29373 leader_election.cc:288] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793), 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529)
I20260811 14:26:08.254360 29050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee5dfdb9867496283a212527adb9924" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550d6987e48b415884bcfd20beb7b0b6" is_pre_election: true
I20260811 14:26:08.254364 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee5dfdb9867496283a212527adb9924" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48ea683de86a4401bbb38baa661be658" is_pre_election: true
I20260811 14:26:08.254482 28887 raft_consensus.cc:2454] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 0.
I20260811 14:26:08.254482 29050 raft_consensus.cc:2454] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 0.
I20260811 14:26:08.254648 29129 leader_election.cc:302] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191830b8fc8c45f89e22d58b1afa25c9, 550d6987e48b415884bcfd20beb7b0b6; no voters:
I20260811 14:26:08.254781 29373 raft_consensus.cc:2781] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:08.254828 29373 raft_consensus.cc:482] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:08.254848 29373 raft_consensus.cc:3037] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:08.255666 29373 raft_consensus.cc:504] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.255818 29373 leader_election.cc:288] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 election: Requested vote from peers 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793), 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529)
I20260811 14:26:08.255990 29050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee5dfdb9867496283a212527adb9924" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550d6987e48b415884bcfd20beb7b0b6"
I20260811 14:26:08.255978 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ee5dfdb9867496283a212527adb9924" candidate_uuid: "191830b8fc8c45f89e22d58b1afa25c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48ea683de86a4401bbb38baa661be658"
I20260811 14:26:08.256067 28887 raft_consensus.cc:3037] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:08.256067 29050 raft_consensus.cc:3037] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:08.256875 28887 raft_consensus.cc:2454] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 1.
I20260811 14:26:08.256875 29050 raft_consensus.cc:2454] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191830b8fc8c45f89e22d58b1afa25c9 in term 1.
I20260811 14:26:08.257054 29129 leader_election.cc:302] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191830b8fc8c45f89e22d58b1afa25c9, 550d6987e48b415884bcfd20beb7b0b6; no voters:
I20260811 14:26:08.257175 29373 raft_consensus.cc:2781] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:08.257359 29373 raft_consensus.cc:686] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 LEADER]: Becoming Leader. State: Replica: 191830b8fc8c45f89e22d58b1afa25c9, State: Running, Role: LEADER
I20260811 14:26:08.257431 29373 consensus_queue.cc:237] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } }
I20260811 14:26:08.257745 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.257616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:44269)
0811 14:26:08.257670 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.257707 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 14:26:08.258111 28733 catalog_manager.cc:5495] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "191830b8fc8c45f89e22d58b1afa25c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191830b8fc8c45f89e22d58b1afa25c9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45525 } health_report { overall_health: HEALTHY } } }
I20260811 14:26:08.287631 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.285608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48558 (local address 127.20.132.195:45525)
0811 14:26:08.285664 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:08.285666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:08.285673 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:08.285698 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:08.285699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:08.285708 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:08.285757 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:08.285875 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.286341 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.287058 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:08.287244 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:08.287294 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:08.287399 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:08.287423 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:08.287456 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:08.287526 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 14:26:08.287542 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:08.288655 29050 raft_consensus.cc:1261] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Refusing update from remote peer 191830b8fc8c45f89e22d58b1afa25c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:08.288681 28887 raft_consensus.cc:1261] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Refusing update from remote peer 191830b8fc8c45f89e22d58b1afa25c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:08.288924 29379 consensus_queue.cc:1035] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550d6987e48b415884bcfd20beb7b0b6" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 46529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:08.289026 29373 consensus_queue.cc:1035] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48ea683de86a4401bbb38baa661be658" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:08.289821 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.289685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:49587)
0811 14:26:08.289734 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.289779 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 14:26:08.289999 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.289863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:36595)
0811 14:26:08.289923 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.289955 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 14:26:08.291384 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.291298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.193:57799)
0811 14:26:08.291335 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.291358 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 14:26:08.291638 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.291544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.195:59483)
0811 14:26:08.291586 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.291610 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 14:26:08.291924 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.291837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:46271 (local address 127.20.132.194:46773)
0811 14:26:08.291875 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.291899 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:46271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 14:26:08.292472 29382 mvcc.cc:205] Tried to move back new op lower bound from 7317333476508364800 to 7317333476382846976. Current Snapshot: MvccSnapshot[applied={T|T < 7317333476508364800 or (T in {7317333476508364800})}]
I20260811 14:26:08.292574 28733 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:08.292680 28733 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:08.294016 28733 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48b918eb5fee461b913b5257aaaea7c6: Sending DeleteTablet for 3 replicas of tablet 1ee5dfdb9867496283a212527adb9924
I20260811 14:26:08.294307 28864 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ee5dfdb9867496283a212527adb9924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:08 UTC) from {username='oryx', principal='oryx/127.20.132.252@KRBTEST.COM'} at 127.0.0.1:54136
I20260811 14:26:08.294332 29183 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ee5dfdb9867496283a212527adb9924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:08 UTC) from {username='oryx', principal='oryx/127.20.132.252@KRBTEST.COM'} at 127.0.0.1:48542
I20260811 14:26:08.294507 29393 tablet_replica.cc:330] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: stopping tablet replica
I20260811 14:26:08.294507 29394 tablet_replica.cc:330] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: stopping tablet replica
I20260811 14:26:08.294569 29394 raft_consensus.cc:2229] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:08.294569 29393 raft_consensus.cc:2229] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:08.294618 29393 raft_consensus.cc:2258] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:08.294631 29394 raft_consensus.cc:2258] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:08.294701 29025 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ee5dfdb9867496283a212527adb9924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:08 UTC) from {username='oryx', principal='oryx/127.20.132.252@KRBTEST.COM'} at 127.0.0.1:56642
I20260811 14:26:08.294888 29393 ts_tablet_manager.cc:1905] T 1ee5dfdb9867496283a212527adb9924 P 48ea683de86a4401bbb38baa661be658: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:08.294930 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 28690
I20260811 14:26:08.297575 29394 ts_tablet_manager.cc:1905] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:08.299672 29394 ts_tablet_manager.cc:1918] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:08.299744 29394 log.cc:1196] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/1ee5dfdb9867496283a212527adb9924
I20260811 14:26:08.299999 29394 ts_tablet_manager.cc:1939] T 1ee5dfdb9867496283a212527adb9924 P 191830b8fc8c45f89e22d58b1afa25c9: Deleting consensus metadata
I20260811 14:26:08.300267 29395 tablet_replica.cc:330] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: stopping tablet replica
I20260811 14:26:08.300347 29395 raft_consensus.cc:2229] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:08.300400 29395 raft_consensus.cc:2258] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:08.300392 28720 catalog_manager.cc:4841] TS 191830b8fc8c45f89e22d58b1afa25c9 (127.20.132.195:45525): tablet 1ee5dfdb9867496283a212527adb9924 (table test-table [id=b8ffe9f5475d490a91f065ea90184112]) successfully deleted
I20260811 14:26:08.300698 29395 ts_tablet_manager.cc:1905] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:08.301963 29395 ts_tablet_manager.cc:1918] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:08.302042 29395 log.cc:1196] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/1ee5dfdb9867496283a212527adb9924
I20260811 14:26:08.302268 29395 ts_tablet_manager.cc:1939] T 1ee5dfdb9867496283a212527adb9924 P 550d6987e48b415884bcfd20beb7b0b6: Deleting consensus metadata
I20260811 14:26:08.302591 28720 catalog_manager.cc:4841] TS 550d6987e48b415884bcfd20beb7b0b6 (127.20.132.194:46529): tablet 1ee5dfdb9867496283a212527adb9924 (table test-table [id=b8ffe9f5475d490a91f065ea90184112]) successfully deleted
I20260811 14:26:08.303740 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:08.303609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:46793 (local address 127.0.0.1:54138)
0811 14:26:08.303676 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:08.303704 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:46793: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 14:26:08.303892 28719 catalog_manager.cc:4584] TS 48ea683de86a4401bbb38baa661be658 (127.20.132.193:46793): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ee5dfdb9867496283a212527adb9924: Network error: Client connection negotiation failed: client connection to 127.20.132.193:46793: connect: Connection refused (error 111)
I20260811 14:26:08.303912 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 28950
I20260811 14:26:08.310829 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 29108
I20260811 14:26:08.321321 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 28366
I20260811 14:26:08.329219 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 28583
2026-08-11T14:26:08Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4845 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:08 dist-test-slave-cbbz krb5kdc[29398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:08 dist-test-slave-cbbz krb5kdc[29398](info): set up 2 sockets
Aug 11 14:26:08 dist-test-slave-cbbz krb5kdc[29398](info): commencing operation
krb5kdc: starting...
W20260811 14:26:09.422295 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:09 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab.
Entry for principal oryx/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab.
I20260811 14:26:09.543097 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:42527
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab
--principal=oryx/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:42527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:09.626052 29412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:09.626266 29412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:09.626291 29412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:09.627461 29412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:09.627526 29412 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 14:26:09.627560 29412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:09.627583 29412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:09.627611 29412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:09.627628 29412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:09.629235 29412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:42527
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.254.keytab
--principal=oryx/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:42527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:09.629417 29412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:09.629586 29412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:09.634326 29421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:09.634301 29417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:09.634361 29419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:09.634567 29412 server_base.cc:1034] running on GCE node
I20260811 14:26:09.634856 29412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:09.635159 29412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:09.636324 29412 hybrid_clock.cc:648] HybridClock initialized: now 1786458369636318 us; error 37 us; skew 500 ppm
Aug 11 14:26:09 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:09.638911 29412 init.cc:377] Logged in from keytab as oryx/127.20.132.254@KRBTEST.COM (short username oryx)
I20260811 14:26:09.639364 29412 webserver.cc:460] Webserver started at http://127.20.132.254:35859/ using document root <none> and password file <none>
I20260811 14:26:09.639562 29412 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:09.639602 29412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:09.639699 29412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:09.640852 29412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "7eb4b9f60ee1423cb5722f454f50a8a5"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "95b663fd3570c4e3e33c78b401a985cd"
server_key_iv: "cb394a819508d32861b73709fbdf1531"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.641170 29412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "7eb4b9f60ee1423cb5722f454f50a8a5"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "95b663fd3570c4e3e33c78b401a985cd"
server_key_iv: "cb394a819508d32861b73709fbdf1531"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.642453 29412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:26:09.643157 29430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:09.643330 29412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:09.643419 29412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "7eb4b9f60ee1423cb5722f454f50a8a5"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "95b663fd3570c4e3e33c78b401a985cd"
server_key_iv: "cb394a819508d32861b73709fbdf1531"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.643472 29412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:09.657670 29412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:09.659897 29412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:09.660008 29412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:09.664602 29412 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:42527
I20260811 14:26:09.664681 29501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:42527 every 8 connection(s)
I20260811 14:26:09.665037 29412 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:09.665733 29502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:09.667759 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 29412
I20260811 14:26:09.667862 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:09.668084 21011 external_mini_cluster.cc:1428] Setting key bf9c49d71f5aeec9c916529e2b83afe7
I20260811 14:26:09.668282 29502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Bootstrap starting.
I20260811 14:26:09.668963 29502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:09.669277 29502 log.cc:824] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:09.670109 29502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: No bootstrap required, opened a new log
I20260811 14:26:09.672545 29502 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42527 } }
I20260811 14:26:09.672694 29502 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:09.672719 29502 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb4b9f60ee1423cb5722f454f50a8a5, State: Initialized, Role: FOLLOWER
I20260811 14:26:09.672869 29502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42527 } }
I20260811 14:26:09.672931 29502 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:09.672952 29502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:09.673022 29502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:09.673580 29502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42527 } }
I20260811 14:26:09.673666 29502 leader_election.cc:302] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7eb4b9f60ee1423cb5722f454f50a8a5; no voters:
I20260811 14:26:09.673894 29502 leader_election.cc:288] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:09.673920 29509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:09.674033 29509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb4b9f60ee1423cb5722f454f50a8a5, State: Running, Role: LEADER
I20260811 14:26:09.674136 29509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42527 } }
I20260811 14:26:09.674163 29502 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:09.674706 29509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7eb4b9f60ee1423cb5722f454f50a8a5. Latest consensus state: current_term: 1 leader_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42527 } } }
I20260811 14:26:09.674717 29511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb4b9f60ee1423cb5722f454f50a8a5" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42527 } } }
I20260811 14:26:09.674890 29509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:09.674911 29511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5 [sys.catalog]: This master's current role is: LEADER
Aug 11 14:26:09 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
W20260811 14:26:09.676245 29528 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:26:09.676311 29528 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:26:09.676380 29520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:09.676602 29520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:09.678074 29520 catalog_manager.cc:1347] Generated new cluster ID: af0082a1ef814ff69ba969ab63dc7e70
I20260811 14:26:09.678126 29520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:09.679697 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:09.668700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.20.132.254:42527)
0811 14:26:09.668902 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:09.668912 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:09.668949 (+ 37us) server_negotiation.cc:407] Connection header received
0811 14:26:09.669472 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:09.669482 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:09.669549 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:09.669708 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:09.670527 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.671370 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.672432 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.672962 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.673062 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:09.676001 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:09.676006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:09.676006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:09.676018 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:09.678060 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:09.678493 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:09.678495 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:09.678496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:09.678594 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:09.678828 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:09.678829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:09.678829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:09.679103 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:09.679257 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:09.679373 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 14:26:09.679495 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":109,"threads_started":1}
I20260811 14:26:09.700225 29520 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:09.700966 29520 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:09.705698 29520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Generated new TSK 0
I20260811 14:26:09.705890 29520 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab.
Entry for principal oryx/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab.
I20260811 14:26:09.740792 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42527
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:09.822880 29533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:09.823083 29533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:09.823107 29533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:09.824275 29533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:09.824314 29533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:09.824335 29533 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:26:09.824390 29533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:09.825955 29533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:42527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:09.826210 29533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:09.826435 29533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:09.831513 29539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:09.831506 29541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:09.831506 29538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:09.831661 29533 server_base.cc:1034] running on GCE node
I20260811 14:26:09.831938 29533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:09.832290 29533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:09.833475 29533 hybrid_clock.cc:648] HybridClock initialized: now 1786458369833466 us; error 57 us; skew 500 ppm
Aug 11 14:26:09 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:09.840896 29533 init.cc:377] Logged in from keytab as oryx/127.20.132.193@KRBTEST.COM (short username oryx)
I20260811 14:26:09.841328 29533 webserver.cc:460] Webserver started at http://127.20.132.193:33873/ using document root <none> and password file <none>
I20260811 14:26:09.841566 29533 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:09.841634 29533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:09.841814 29533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:09.842871 29533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "896c58f5c0504874572c3d2298fd3f27"
server_key_iv: "c6e6fb05ded1c4d5ce83f62577b4c3ef"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.843246 29533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "896c58f5c0504874572c3d2298fd3f27"
server_key_iv: "c6e6fb05ded1c4d5ce83f62577b4c3ef"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.844666 29533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:09.845461 29548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:09.845677 29533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:09.845762 29533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "896c58f5c0504874572c3d2298fd3f27"
server_key_iv: "c6e6fb05ded1c4d5ce83f62577b4c3ef"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.845815 29533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:09.858254 29533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:09.860103 29533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:09.860272 29533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:09.860710 29533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:09.860778 29533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:09.860826 29533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:09.860853 29533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:26:09 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:09.867735 29533 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:44381
I20260811 14:26:09.867801 29680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:44381 every 8 connection(s)
I20260811 14:26:09.868098 29533 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:09.871089 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:09.861205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:46147 (local address 127.20.132.254:42527)
0811 14:26:09.861277 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:09.861280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:09.861459 (+ 179us) server_negotiation.cc:407] Connection header received
0811 14:26:09.861982 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:09.861984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:09.861996 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:09.862130 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:09.862962 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.863823 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.865015 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.865389 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.865458 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:09.868255 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:09.868256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:09.868257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:09.868265 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:09.869546 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:09.869964 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:09.869965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:09.869966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:09.870024 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:09.870413 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:09.870415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:09.870415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:09.870547 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:09.870627 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:09.870904 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 14:26:09.870999 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:26:09.871258 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:09.861173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.20.132.193:46147)
0811 14:26:09.861329 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:09.861368 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:09.861883 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:09.862201 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:09.862209 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:09.862573 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:09.862851 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:09.862858 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.863947 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.863948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:09.864915 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:09.864918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.865547 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.865548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:09.865705 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:09.866221 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:09.866237 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:09.868116 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:09.869645 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:09.869652 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:09.869654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:09.869872 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:09.870213 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:09.870214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:09.870215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:09.870337 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:09.870619 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:09.870627 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:09.870769 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 14:26:09.870881 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 14:26:09.871038 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260811 14:26:09.871797 29681 heartbeater.cc:347] Connected to a master server at 127.20.132.254:42527
I20260811 14:26:09.871876 29681 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:09.872056 29681 heartbeater.cc:511] Master 127.20.132.254:42527 requested a full tablet report, sending...
I20260811 14:26:09.872568 29450 ts_manager.cc:194] Registered new tserver with Master: 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381)
I20260811 14:26:09.873226 29450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:46147
I20260811 14:26:09.876047 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 29533
I20260811 14:26:09.876200 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:09.876439 21011 external_mini_cluster.cc:1428] Setting key a34672dfea7a625e7d061708b2d7150d
I20260811 14:26:09.879318 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:09.873543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.20.132.193:37805)
0811 14:26:09.873716 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:09.873726 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:09.873805 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:09.873944 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:09.873945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:09.874124 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:09.874178 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:09.874179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.874898 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.874898 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:09.875481 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:09.875484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.875856 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.875857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:09.875923 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:09.876411 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:09.876415 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:09.876816 (+ 401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:09.878295 (+ 1479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:09.878295 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:09.878296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:09.878467 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:09.878705 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:09.878707 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:09.878707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:09.878791 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:09.879080 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:09.879080 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:09.879118 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 14:26:09.879181 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:26:09.879258 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":91,"threads_started":1}
I20260811 14:26:09.879422 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:09.873630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:37805 (local address 127.20.132.254:42527)
0811 14:26:09.873692 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:09.873694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:09.873788 (+ 94us) server_negotiation.cc:407] Connection header received
0811 14:26:09.873859 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:09.873860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:09.873870 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:09.873938 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:09.874277 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.874786 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.875581 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:09.875772 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:09.875844 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:09.876905 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:09.876906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:09.876907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:09.876913 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:09.878212 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:09.878561 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:09.878562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:09.878562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:09.878619 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:09.878873 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:09.878874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:09.878874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:09.879014 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:09.879085 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:09.879225 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 14:26:09.879307 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
WARNING: no policy specified for oryx/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab.
Entry for principal oryx/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab.
I20260811 14:26:09.902623 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42527
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:09.983700 29691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:09.983892 29691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:09.983916 29691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:09.985070 29691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:09.985112 29691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:09.985133 29691 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:26:09.985201 29691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:09.986654 29691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:42527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:09.986887 29691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:09.987118 29691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:09.991964 29696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:09.991964 29699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:09.992036 29697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:09.992130 29691 server_base.cc:1034] running on GCE node
I20260811 14:26:09.992455 29691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:09.992707 29691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:09.993871 29691 hybrid_clock.cc:648] HybridClock initialized: now 1786458369993855 us; error 48 us; skew 500 ppm
Aug 11 14:26:09 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:09.996338 29691 init.cc:377] Logged in from keytab as oryx/127.20.132.194@KRBTEST.COM (short username oryx)
I20260811 14:26:09.996752 29691 webserver.cc:460] Webserver started at http://127.20.132.194:36555/ using document root <none> and password file <none>
I20260811 14:26:09.996975 29691 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:09.997041 29691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:09.997198 29691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:09.998219 29691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "fc7903d26487467abe681d74be7789a1"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "6369faef893de393a31994979a0588b5"
server_key_iv: "ce0efb9080cf90b6f73015b823da3faf"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.998577 29691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "fc7903d26487467abe681d74be7789a1"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "6369faef893de393a31994979a0588b5"
server_key_iv: "ce0efb9080cf90b6f73015b823da3faf"
server_key_version: "encryptionkey@0"
I20260811 14:26:09.999871 29691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 14:26:10.000648 29706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.000833 29691 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.000929 29691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "fc7903d26487467abe681d74be7789a1"
format_stamp: "Formatted at 2026-08-11 14:26:09 on dist-test-slave-cbbz"
server_key: "6369faef893de393a31994979a0588b5"
server_key_iv: "ce0efb9080cf90b6f73015b823da3faf"
server_key_version: "encryptionkey@0"
I20260811 14:26:10.001016 29691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:10.018718 29691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:10.020490 29691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:10.020654 29691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:10.021195 29691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:10.021252 29691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.021283 29691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:10.021312 29691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:10.028491 29691 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:44037
I20260811 14:26:10.028769 29835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:44037 every 8 connection(s)
I20260811 14:26:10.028911 29691 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:10.030900 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.021611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:60971 (local address 127.20.132.254:42527)
0811 14:26:10.021685 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.021687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.021890 (+ 203us) server_negotiation.cc:407] Connection header received
0811 14:26:10.022348 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.022350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.022364 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.022445 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.023061 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.023876 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.024974 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.025192 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.025281 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.027985 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.027986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.027987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.027994 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.029774 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.030152 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.030153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.030153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.030212 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.030431 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.030431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.030431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.030535 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.030593 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.030773 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.030837 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:26:10.031051 29716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.021586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.20.132.194:60971)
0811 14:26:10.021732 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.021783 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.022248 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.022509 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.022512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.022740 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:10.022969 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.022974 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.023982 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.023983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.024880 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.024882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.025294 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.025295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.025410 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.025934 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:10.025943 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:10.027898 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:10.029844 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.029848 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.029850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.030054 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.030280 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.030281 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.030281 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.030373 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.030584 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:10.030586 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:10.030684 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.030760 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.030871 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260811 14:26:10.031565 29836 heartbeater.cc:347] Connected to a master server at 127.20.132.254:42527
I20260811 14:26:10.031646 29836 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:10.031837 29836 heartbeater.cc:511] Master 127.20.132.254:42527 requested a full tablet report, sending...
I20260811 14:26:10.032275 29449 ts_manager.cc:194] Registered new tserver with Master: fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:10.032706 29449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:60971
I20260811 14:26:10.037552 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 29691
I20260811 14:26:10.037667 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:10.037757 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.032674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:42623 (local address 127.20.132.254:42527)
0811 14:26:10.032898 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.032900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.032906 (+ 6us) server_negotiation.cc:407] Connection header received
0811 14:26:10.032920 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.032921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.032927 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.032968 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.033303 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.033807 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.034457 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.034635 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.034688 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.035541 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.035542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.035542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.035548 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.036706 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.036997 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.036998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.036998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.037045 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.037210 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.037210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.037211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.037345 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.037394 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.037572 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.037663 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210}
I20260811 14:26:10.037767 29842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.032618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.20.132.194:42623)
0811 14:26:10.032731 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.032742 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.032792 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.032993 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.032993 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.033163 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:10.033225 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.033226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.033887 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.033887 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.034385 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.034386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.034703 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.034704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.034749 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.035154 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:10.035159 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:10.035467 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:10.036773 (+ 1306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.036774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.036774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.036932 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.037100 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.037101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.037101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.037148 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.037414 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:10.037415 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:10.037462 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.037545 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.037652 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":72,"threads_started":1}
I20260811 14:26:10.037914 21011 external_mini_cluster.cc:1428] Setting key 4943d0c5a317c9b98933bebdb02fa29f
WARNING: no policy specified for oryx/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab.
Entry for principal oryx/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab.
I20260811 14:26:10.063668 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:42527
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:10.147092 29845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:10.147305 29845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:10.147330 29845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:10.148720 29845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:10.148793 29845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:10.148833 29845 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:26:10.148869 29845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:10.150408 29845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.132.254:42527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:10.150672 29845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:10.150918 29845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:10.156124 29853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:10.156153 29850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:10.156191 29851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:10.156394 29845 server_base.cc:1034] running on GCE node
I20260811 14:26:10.156618 29845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:10.156878 29845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:10.158056 29845 hybrid_clock.cc:648] HybridClock initialized: now 1786458370158047 us; error 27 us; skew 500 ppm
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458370, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:10.160750 29845 init.cc:377] Logged in from keytab as oryx/127.20.132.195@KRBTEST.COM (short username oryx)
I20260811 14:26:10.161226 29845 webserver.cc:460] Webserver started at http://127.20.132.195:42333/ using document root <none> and password file <none>
I20260811 14:26:10.161415 29845 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:10.161456 29845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:10.161549 29845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:10.162603 29845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "674a458a1df340f3b64b32478db36d8b"
format_stamp: "Formatted at 2026-08-11 14:26:10 on dist-test-slave-cbbz"
server_key: "ed50a46383842a6b1f93badc2fdf6fc6"
server_key_iv: "3bc3045ceae14a823ee71d0e7a336128"
server_key_version: "encryptionkey@0"
I20260811 14:26:10.162918 29845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "674a458a1df340f3b64b32478db36d8b"
format_stamp: "Formatted at 2026-08-11 14:26:10 on dist-test-slave-cbbz"
server_key: "ed50a46383842a6b1f93badc2fdf6fc6"
server_key_iv: "3bc3045ceae14a823ee71d0e7a336128"
server_key_version: "encryptionkey@0"
I20260811 14:26:10.164304 29845 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:26:10.165046 29860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.165249 29845 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:10.165338 29845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "674a458a1df340f3b64b32478db36d8b"
format_stamp: "Formatted at 2026-08-11 14:26:10 on dist-test-slave-cbbz"
server_key: "ed50a46383842a6b1f93badc2fdf6fc6"
server_key_iv: "3bc3045ceae14a823ee71d0e7a336128"
server_key_version: "encryptionkey@0"
I20260811 14:26:10.165397 29845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:10.189903 29845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:10.191803 29845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:10.191918 29845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:10.192550 29845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:10.192590 29845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.192615 29845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:10.192627 29845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.200114 29845 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:35563
I20260811 14:26:10.200218 29991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:35563 every 8 connection(s)
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458370, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:10.200515 29845 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:10.203647 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.193067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:49587 (local address 127.20.132.254:42527)
0811 14:26:10.193150 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.193153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.193405 (+ 252us) server_negotiation.cc:407] Connection header received
0811 14:26:10.194171 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.194172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.194183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.194284 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.195231 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.196057 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.197757 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.198065 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.198146 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.201032 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.201033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.201033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.201040 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.202456 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.202834 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.202834 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.202835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.202886 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.203095 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.203095 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.203096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.203206 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.203256 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.203467 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.203576 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:26:10.203859 29869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.193026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.20.132.195:49587)
0811 14:26:10.193258 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.193311 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.194040 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.194385 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.194390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.194797 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:10.195103 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.195110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.196193 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.196194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.197646 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.197650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.198185 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.198187 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.198348 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.199057 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:10.199069 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:10.200915 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:10.202533 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.202537 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.202539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.202764 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.202946 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.202947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.202947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.203041 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.203261 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:10.203265 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:10.203371 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.203451 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.203638 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":127,"threads_started":1}
I20260811 14:26:10.204429 29992 heartbeater.cc:347] Connected to a master server at 127.20.132.254:42527
I20260811 14:26:10.204535 29992 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:10.204761 29992 heartbeater.cc:511] Master 127.20.132.254:42527 requested a full tablet report, sending...
I20260811 14:26:10.205219 29450 ts_manager.cc:194] Registered new tserver with Master: 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563)
I20260811 14:26:10.205744 29450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:49587
I20260811 14:26:10.209195 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 29845
I20260811 14:26:10.209313 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:10.209497 21011 external_mini_cluster.cc:1428] Setting key c77a8e49a9ae004135b990f605f545ec
I20260811 14:26:10.210273 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:26:10.211364 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.205567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:36677 (local address 127.20.132.254:42527)
0811 14:26:10.205608 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.205610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.205744 (+ 134us) server_negotiation.cc:407] Connection header received
0811 14:26:10.205896 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.205897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.205908 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.205961 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.206310 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.206773 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.207458 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.207662 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.207734 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.208735 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.208736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.208736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.208743 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.210199 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.210560 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.210561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.210562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.210616 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.210838 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.210839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.210839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.210964 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.211041 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.211211 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.211281 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:10.211374 30000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.205511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.20.132.195:36677)
0811 14:26:10.205653 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.205665 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.205834 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.205965 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.205966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.206171 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:10.206226 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.206227 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.206867 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.206868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.207375 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.207377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.207745 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.207746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.207814 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.208298 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:10.208303 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:10.208620 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:10.210301 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.210302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.210302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.210488 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.210705 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.210706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.210706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.210769 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.211034 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:10.211035 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:10.211081 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.211165 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.211270 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":219,"threads_started":1}
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458370, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:26:10.232477 29507 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:10.226771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49132 (local address 127.20.132.254:42527)
0811 14:26:10.226835 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.226837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.226848 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:26:10.226913 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.226914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.226931 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.226997 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.227577 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.228128 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.228917 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.229208 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.229283 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.232368 (+ 3085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49132: BlockingRecv error: recv got EOF from 127.0.0.1:49132 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458370, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:10.240833 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.233485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49144 (local address 127.20.132.254:42527)
0811 14:26:10.233525 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.233527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.233635 (+ 108us) server_negotiation.cc:407] Connection header received
0811 14:26:10.233733 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.233734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.233764 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.233816 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.234509 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.235247 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.236432 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.236708 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.236766 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.238729 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.238730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.238730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.238736 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.239856 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.240241 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.240242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.240243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.240292 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.240459 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.240460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.240460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.240556 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.240632 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.240716 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.240771 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:26:10.242470 29450 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:26:10.244083 29450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:10.251222 30026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.246918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36778 (local address 127.20.132.193:44381)
0811 14:26:10.247241 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.247245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.247256 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:26:10.247297 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.247300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.247318 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.247400 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.247644 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.248842 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250002 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.250764 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250868 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.250931 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.251076 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.251115 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":110,"threads_started":1}
I20260811 14:26:10.251251 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.246764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:44037 (local address 127.0.0.1:44972)
0811 14:26:10.247126 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.247134 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.247187 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.247480 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.247483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.247484 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.247558 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.247560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.248931 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.248931 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.250029 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.250032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.250876 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250876 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.250961 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.250976 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.251053 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.251124 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":15,"thread_start_us":90,"threads_started":1}
I20260811 14:26:10.251251 30020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.246552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44381 (local address 127.0.0.1:36778)
0811 14:26:10.246920 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.246962 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.247029 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.247477 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.247481 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.247483 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.247556 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.247558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.248958 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.248959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.249909 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.249912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.250874 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.250968 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.250976 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.251053 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.251123 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":28,"thread_start_us":62,"threads_started":1}
I20260811 14:26:10.251585 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.246918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44972 (local address 127.20.132.194:44037)
0811 14:26:10.247161 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.247166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.247182 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:26:10.247327 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.247329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.247346 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.247415 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.247644 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.248850 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250125 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.250803 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250887 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.250931 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.251340 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.251491 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260811 14:26:10.252296 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.246552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35563 (local address 127.0.0.1:50818)
0811 14:26:10.247094 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.247104 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.247151 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.247485 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.247486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.247488 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.247556 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.247557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.248639 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.248640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.250029 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.250032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.252023 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.252024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.252085 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.252088 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.252173 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.252218 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":60,"thread_start_us":80,"threads_started":1}
I20260811 14:26:10.252380 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.246675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50818 (local address 127.20.132.195:35563)
0811 14:26:10.247275 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.247279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.247290 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:26:10.247330 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.247332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.247348 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.247422 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.247642 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.248554 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.250971 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.251847 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.251936 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.251987 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.252206 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.252252 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":133,"threads_started":1}
I20260811 14:26:10.252256 29762 tablet_service.cc:1467] Processing CreateTablet for tablet fd3cef46656545cd8d97c5b14855c93b (DEFAULT_TABLE table=test-table [id=9e710674508243b2811f963101564069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.252254 29605 tablet_service.cc:1467] Processing CreateTablet for tablet fd3cef46656545cd8d97c5b14855c93b (DEFAULT_TABLE table=test-table [id=9e710674508243b2811f963101564069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.252624 29605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd3cef46656545cd8d97c5b14855c93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.252630 29762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd3cef46656545cd8d97c5b14855c93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.252987 29918 tablet_service.cc:1467] Processing CreateTablet for tablet fd3cef46656545cd8d97c5b14855c93b (DEFAULT_TABLE table=test-table [id=9e710674508243b2811f963101564069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.253335 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd3cef46656545cd8d97c5b14855c93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.255659 30027 tablet_bootstrap.cc:492] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Bootstrap starting.
I20260811 14:26:10.256305 30027 tablet_bootstrap.cc:654] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.256451 30028 tablet_bootstrap.cc:492] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Bootstrap starting.
I20260811 14:26:10.256711 30027 log.cc:824] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:10.257071 30028 tablet_bootstrap.cc:654] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.257190 30030 tablet_bootstrap.cc:492] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Bootstrap starting.
I20260811 14:26:10.257419 30028 log.cc:824] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:10.257622 30027 tablet_bootstrap.cc:492] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: No bootstrap required, opened a new log
I20260811 14:26:10.257704 30027 ts_tablet_manager.cc:1397] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:26:10.257870 30030 tablet_bootstrap.cc:654] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.258133 30030 log.cc:824] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:10.258369 30028 tablet_bootstrap.cc:492] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: No bootstrap required, opened a new log
I20260811 14:26:10.258443 30028 ts_tablet_manager.cc:1397] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:26:10.258772 30030 tablet_bootstrap.cc:492] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: No bootstrap required, opened a new log
I20260811 14:26:10.258854 30030 ts_tablet_manager.cc:1397] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:26:10.259814 30027 raft_consensus.cc:348] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.259979 30027 raft_consensus.cc:374] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.260015 30027 raft_consensus.cc:729] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b96e2bf22c4e6989ac3a67bc55945b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.260166 30027 consensus_queue.cc:260] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.260432 30027 ts_tablet_manager.cc:1428] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:26:10.260406 30030 raft_consensus.cc:348] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.260437 30028 raft_consensus.cc:348] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.260557 29681 heartbeater.cc:503] Master 127.20.132.254:42527 was elected leader, sending a full tablet report...
I20260811 14:26:10.260553 30030 raft_consensus.cc:374] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.260568 30028 raft_consensus.cc:374] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.260596 30030 raft_consensus.cc:729] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.260602 30028 raft_consensus.cc:729] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7903d26487467abe681d74be7789a1, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.260727 30028 consensus_queue.cc:260] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.260735 30030 consensus_queue.cc:260] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.260977 30028 ts_tablet_manager.cc:1428] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 14:26:10.261008 30030 ts_tablet_manager.cc:1428] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:26:10.261093 29836 heartbeater.cc:503] Master 127.20.132.254:42527 was elected leader, sending a full tablet report...
I20260811 14:26:10.261135 29992 heartbeater.cc:503] Master 127.20.132.254:42527 was elected leader, sending a full tablet report...
W20260811 14:26:10.279479 29837 tablet.cc:2369] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:26:10.368857 29682 tablet.cc:2369] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:26:10.451171 29994 tablet.cc:2369] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:26:10.575220 30036 raft_consensus.cc:482] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:10.575379 30036 raft_consensus.cc:504] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.575801 30036 leader_election.cc:288] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:10.579900 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.576018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:44037 (local address 127.20.132.195:44421)
0811 14:26:10.576224 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.576234 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.576298 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.576448 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.576449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.576450 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.576519 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.576520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.577458 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.577459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.578835 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.578836 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.579586 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.579587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.579678 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.579683 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.579746 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.579793 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":87,"thread_start_us":109,"threads_started":1}
I20260811 14:26:10.579914 30026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.576087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:60813 (local address 127.20.132.193:44381)
0811 14:26:10.576130 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.576132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.576142 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:10.576237 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.576239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.576251 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.576328 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.576524 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.577342 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.578943 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.579494 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.579573 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.579581 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.579793 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.579841 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:26:10.579914 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.576074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:44421 (local address 127.20.132.194:44037)
0811 14:26:10.576125 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.576127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.576317 (+ 190us) server_negotiation.cc:407] Connection header received
0811 14:26:10.576371 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.576372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.576380 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.576429 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.576610 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.577353 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.578943 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.579494 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.579572 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.579581 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.579792 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.579848 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 14:26:10.579908 29869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.576009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44381 (local address 127.20.132.195:60813)
0811 14:26:10.576079 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.576091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.576140 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.576348 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.576349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.576350 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.576445 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.576446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.577458 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.577459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.578832 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.578836 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.579586 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.579587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.579690 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.579693 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.579746 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.579793 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":69}
I20260811 14:26:10.580507 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3cef46656545cd8d97c5b14855c93b" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1" is_pre_election: true
I20260811 14:26:10.580513 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3cef46656545cd8d97c5b14855c93b" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" is_pre_election: true
I20260811 14:26:10.580674 29782 raft_consensus.cc:2454] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:10.580690 29629 raft_consensus.cc:2454] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:10.581207 29864 leader_election.cc:302] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 674a458a1df340f3b64b32478db36d8b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:10.581416 30036 raft_consensus.cc:2781] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:10.581478 30036 raft_consensus.cc:482] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:10.581509 30036 raft_consensus.cc:3037] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.582254 30036 raft_consensus.cc:504] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.582407 30036 leader_election.cc:288] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Requested vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:10.582571 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3cef46656545cd8d97c5b14855c93b" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
I20260811 14:26:10.582595 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3cef46656545cd8d97c5b14855c93b" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1"
I20260811 14:26:10.582657 29782 raft_consensus.cc:3037] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.582659 29629 raft_consensus.cc:3037] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.583491 29629 raft_consensus.cc:2454] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:10.583491 29782 raft_consensus.cc:2454] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:10.583671 29864 leader_election.cc:302] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 674a458a1df340f3b64b32478db36d8b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:10.583788 30036 raft_consensus.cc:2781] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:10.583945 30036 raft_consensus.cc:686] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Becoming Leader. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Running, Role: LEADER
I20260811 14:26:10.584065 30036 consensus_queue.cc:237] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } }
I20260811 14:26:10.584936 29450 catalog_manager.cc:5495] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 674a458a1df340f3b64b32478db36d8b (127.20.132.195). New cstate: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } health_report { overall_health: UNKNOWN } } }
I20260811 14:26:10.605052 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.602377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50832 (local address 127.20.132.195:35563)
0811 14:26:10.602451 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.602454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.602462 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:10.602502 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.602503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.602526 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.602603 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:10.602764 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.603237 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.604179 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.604395 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.604502 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.604704 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.604805 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.604918 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.604980 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.604998 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:26:10.606813 29782 raft_consensus.cc:1261] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:10.606813 29629 raft_consensus.cc:1261] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:10.607164 30036 consensus_queue.cc:1035] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:10.607318 30038 consensus_queue.cc:1035] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:10.610487 30042 mvcc.cc:205] Tried to move back new op lower bound from 7317333486002798592 to 7317333485913133056. Current Snapshot: MvccSnapshot[applied={T|T < 7317333486002798592}]
I20260811 14:26:10.612000 29449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:10.612098 29449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:10.612897 29449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Sending DeleteTablet for 3 replicas of tablet fd3cef46656545cd8d97c5b14855c93b
I20260811 14:26:10.613237 29918 tablet_service.cc:1514] Processing DeleteTablet for tablet fd3cef46656545cd8d97c5b14855c93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:10 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:50818
I20260811 14:26:10.613293 29605 tablet_service.cc:1514] Processing DeleteTablet for tablet fd3cef46656545cd8d97c5b14855c93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:10 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36778
I20260811 14:26:10.613300 29762 tablet_service.cc:1514] Processing DeleteTablet for tablet fd3cef46656545cd8d97c5b14855c93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:10 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:44972
I20260811 14:26:10.613505 30056 tablet_replica.cc:330] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: stopping tablet replica
I20260811 14:26:10.613549 30055 tablet_replica.cc:330] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: stopping tablet replica
I20260811 14:26:10.613593 30056 raft_consensus.cc:2229] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:10.613631 30055 raft_consensus.cc:2229] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:10.613710 30056 raft_consensus.cc:2258] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:10.613765 30055 raft_consensus.cc:2258] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:10.613900 30053 tablet_replica.cc:330] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: stopping tablet replica
I20260811 14:26:10.613984 30053 raft_consensus.cc:2229] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:10.613965 29449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 14:26:10.614068 30053 raft_consensus.cc:2258] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 14:26:10.614101 29449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:10.614146 30056 ts_tablet_manager.cc:1905] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:10.614538 30053 ts_tablet_manager.cc:1905] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:10.615660 29762 tablet_service.cc:1467] Processing CreateTablet for tablet 21798650ac95429e9a8f90e98005d848 (DEFAULT_TABLE table=test-table [id=25ae9ec517bb40b5bcd7608ed909072a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.615777 29762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21798650ac95429e9a8f90e98005d848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.615985 29918 tablet_service.cc:1467] Processing CreateTablet for tablet 21798650ac95429e9a8f90e98005d848 (DEFAULT_TABLE table=test-table [id=25ae9ec517bb40b5bcd7608ed909072a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.616107 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21798650ac95429e9a8f90e98005d848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.616406 30055 ts_tablet_manager.cc:1905] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:10.617228 30028 tablet_bootstrap.cc:492] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Bootstrap starting.
I20260811 14:26:10.617616 30028 tablet_bootstrap.cc:654] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.617911 30055 ts_tablet_manager.cc:1918] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:10.617942 30030 tablet_bootstrap.cc:492] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Bootstrap starting.
I20260811 14:26:10.617973 30055 log.cc:1196] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/fd3cef46656545cd8d97c5b14855c93b
I20260811 14:26:10.618063 29605 tablet_service.cc:1467] Processing CreateTablet for tablet 21798650ac95429e9a8f90e98005d848 (DEFAULT_TABLE table=test-table [id=25ae9ec517bb40b5bcd7608ed909072a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.618243 30055 ts_tablet_manager.cc:1939] T fd3cef46656545cd8d97c5b14855c93b P 674a458a1df340f3b64b32478db36d8b: Deleting consensus metadata
I20260811 14:26:10.618391 30030 tablet_bootstrap.cc:654] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.618631 30053 ts_tablet_manager.cc:1918] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:10.618645 29605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21798650ac95429e9a8f90e98005d848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.618698 30053 log.cc:1196] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/fd3cef46656545cd8d97c5b14855c93b
I20260811 14:26:10.618726 30056 ts_tablet_manager.cc:1918] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:10.618786 30056 log.cc:1196] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/fd3cef46656545cd8d97c5b14855c93b
I20260811 14:26:10.618964 30053 ts_tablet_manager.cc:1939] T fd3cef46656545cd8d97c5b14855c93b P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting consensus metadata
I20260811 14:26:10.619061 30056 ts_tablet_manager.cc:1939] T fd3cef46656545cd8d97c5b14855c93b P fc7903d26487467abe681d74be7789a1: Deleting consensus metadata
I20260811 14:26:10.619719 30028 tablet_bootstrap.cc:492] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: No bootstrap required, opened a new log
I20260811 14:26:10.619760 30028 ts_tablet_manager.cc:1397] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 14:26:10.619894 30028 raft_consensus.cc:348] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.619953 30028 raft_consensus.cc:374] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.619935 29434 catalog_manager.cc:4841] TS fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037): tablet fd3cef46656545cd8d97c5b14855c93b (table test-table [id=9e710674508243b2811f963101564069]) successfully deleted
I20260811 14:26:10.619974 30028 raft_consensus.cc:729] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7903d26487467abe681d74be7789a1, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.620000 29434 catalog_manager.cc:4841] TS 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563): tablet fd3cef46656545cd8d97c5b14855c93b (table test-table [id=9e710674508243b2811f963101564069]) successfully deleted
I20260811 14:26:10.620015 30028 consensus_queue.cc:260] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.620159 30028 ts_tablet_manager.cc:1428] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:10.620186 29432 catalog_manager.cc:4841] TS 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381): tablet fd3cef46656545cd8d97c5b14855c93b (table test-table [id=9e710674508243b2811f963101564069]) successfully deleted
I20260811 14:26:10.620256 30027 tablet_bootstrap.cc:492] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Bootstrap starting.
I20260811 14:26:10.620623 30027 tablet_bootstrap.cc:654] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.621088 30030 tablet_bootstrap.cc:492] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: No bootstrap required, opened a new log
I20260811 14:26:10.621153 30030 ts_tablet_manager.cc:1397] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 14:26:10.621330 30030 raft_consensus.cc:348] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.621402 30030 raft_consensus.cc:374] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.621436 30030 raft_consensus.cc:729] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.621477 30030 consensus_queue.cc:260] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.621578 30030 ts_tablet_manager.cc:1428] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:10.622066 30027 tablet_bootstrap.cc:492] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: No bootstrap required, opened a new log
I20260811 14:26:10.622113 30027 ts_tablet_manager.cc:1397] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 14:26:10.622262 30027 raft_consensus.cc:348] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.622324 30027 raft_consensus.cc:374] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.622337 30027 raft_consensus.cc:729] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b96e2bf22c4e6989ac3a67bc55945b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.622390 30027 consensus_queue.cc:260] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.622501 30027 ts_tablet_manager.cc:1428] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.690490 30035 raft_consensus.cc:482] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:10.690585 30035 raft_consensus.cc:504] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.690927 30035 leader_election.cc:288] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563)
I20260811 14:26:10.694773 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.691340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:53161 (local address 127.20.132.195:35563)
0811 14:26:10.691385 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.691387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.691548 (+ 161us) server_negotiation.cc:407] Connection header received
0811 14:26:10.691700 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.691701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.691712 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.691766 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.692042 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.692802 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.693878 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.694388 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.694477 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.694489 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.694659 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.694700 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:26:10.694800 30061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.691143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35563 (local address 127.20.132.194:53161)
0811 14:26:10.691495 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.691503 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.691573 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.691816 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.691817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.691819 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.691911 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.691913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.692924 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.692925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.693777 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.693779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.694503 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.694505 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.694580 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.694583 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.694653 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.694700 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":40,"thread_start_us":84,"threads_started":1}
I20260811 14:26:10.695088 29940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21798650ac95429e9a8f90e98005d848" candidate_uuid: "fc7903d26487467abe681d74be7789a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674a458a1df340f3b64b32478db36d8b" is_pre_election: true
I20260811 14:26:10.695191 30060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.691134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44381 (local address 127.20.132.194:51137)
0811 14:26:10.691308 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.691321 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.691391 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.691743 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.691744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.691746 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:10.691828 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.691831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.692905 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.692906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.694136 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.694139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.694932 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.694933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.695005 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.695009 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.695066 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.695105 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":27,"thread_start_us":101,"threads_started":1}
I20260811 14:26:10.695226 29940 raft_consensus.cc:2454] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7903d26487467abe681d74be7789a1 in term 0.
I20260811 14:26:10.695406 30026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.691512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:51137 (local address 127.20.132.193:44381)
0811 14:26:10.691606 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.691608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.691618 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:10.691649 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.691650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.691659 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.691743 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:10.691923 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.692803 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.694247 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.694802 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.694878 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.694887 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.695275 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.695321 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:26:10.695526 29711 leader_election.cc:302] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 674a458a1df340f3b64b32478db36d8b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:10.695667 30035 raft_consensus.cc:2781] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:10.695705 30035 raft_consensus.cc:482] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:10.695653 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21798650ac95429e9a8f90e98005d848" candidate_uuid: "fc7903d26487467abe681d74be7789a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" is_pre_election: true
I20260811 14:26:10.695725 30035 raft_consensus.cc:3037] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.695758 29629 raft_consensus.cc:2454] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7903d26487467abe681d74be7789a1 in term 0.
I20260811 14:26:10.696561 30035 raft_consensus.cc:504] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.696698 30035 leader_election.cc:288] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [CANDIDATE]: Term 1 election: Requested vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563)
I20260811 14:26:10.696848 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21798650ac95429e9a8f90e98005d848" candidate_uuid: "fc7903d26487467abe681d74be7789a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
I20260811 14:26:10.696892 29940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21798650ac95429e9a8f90e98005d848" candidate_uuid: "fc7903d26487467abe681d74be7789a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674a458a1df340f3b64b32478db36d8b"
I20260811 14:26:10.696925 29629 raft_consensus.cc:3037] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.696952 29940 raft_consensus.cc:3037] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.697795 29629 raft_consensus.cc:2454] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7903d26487467abe681d74be7789a1 in term 1.
I20260811 14:26:10.697795 29940 raft_consensus.cc:2454] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7903d26487467abe681d74be7789a1 in term 1.
I20260811 14:26:10.698006 29709 leader_election.cc:302] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b96e2bf22c4e6989ac3a67bc55945b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:10.698115 30035 raft_consensus.cc:2781] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:10.698279 30035 raft_consensus.cc:686] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 1 LEADER]: Becoming Leader. State: Replica: fc7903d26487467abe681d74be7789a1, State: Running, Role: LEADER
I20260811 14:26:10.698364 30035 consensus_queue.cc:237] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.699070 29449 catalog_manager.cc:5495] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc7903d26487467abe681d74be7789a1 (127.20.132.194). New cstate: current_term: 1 leader_uuid: "fc7903d26487467abe681d74be7789a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } health_report { overall_health: UNKNOWN } } }
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458369, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.254@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:10.763477 30069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.748882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:42527 (local address 127.0.0.1:49158)
0811 14:26:10.749120 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.749134 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.749223 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.749404 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.749405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.749736 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:10.749782 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.749784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.750489 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.750489 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.751156 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.751159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.751710 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.751712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.751765 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.759403 (+ 7638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:10.759409 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:10.760927 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:10.762503 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.762510 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.762512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.762716 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.762897 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:10.762898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:10.762898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:10.762953 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:10.763196 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:10.763201 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:10.763245 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.763297 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.763403 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":127,"threads_started":1}
I20260811 14:26:10.763590 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.748955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49158 (local address 127.20.132.254:42527)
0811 14:26:10.749142 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.749144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.749214 (+ 70us) server_negotiation.cc:407] Connection header received
0811 14:26:10.749301 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.749302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.749313 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.749402 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.749876 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.750398 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.751246 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.751621 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.751685 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.761023 (+ 9338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.761024 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.761024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.761032 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.762425 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.762783 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.762784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.762784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.762839 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.763006 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.763006 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.763006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.763134 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.763186 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.763330 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.763454 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":165,"thread_start_us":74,"threads_started":1}
I20260811 14:26:10.765512 29449 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49158:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 14:26:10.765728 29449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:10.767263 29605 tablet_service.cc:1467] Processing CreateTablet for tablet 6a3a8208dd91409dad4ca10dcf590e63 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=96918c49412841cd9eab00f4d51def8a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:26:10.767264 29762 tablet_service.cc:1467] Processing CreateTablet for tablet 6a3a8208dd91409dad4ca10dcf590e63 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=96918c49412841cd9eab00f4d51def8a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:26:10.767294 29918 tablet_service.cc:1467] Processing CreateTablet for tablet 6a3a8208dd91409dad4ca10dcf590e63 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=96918c49412841cd9eab00f4d51def8a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:26:10.767436 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a3a8208dd91409dad4ca10dcf590e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.767436 29762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a3a8208dd91409dad4ca10dcf590e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.767437 29605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a3a8208dd91409dad4ca10dcf590e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.768817 30027 tablet_bootstrap.cc:492] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: Bootstrap starting.
I20260811 14:26:10.768985 30028 tablet_bootstrap.cc:492] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: Bootstrap starting.
I20260811 14:26:10.769022 30030 tablet_bootstrap.cc:492] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: Bootstrap starting.
I20260811 14:26:10.769310 30027 tablet_bootstrap.cc:654] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.769343 30030 tablet_bootstrap.cc:654] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.769424 30028 tablet_bootstrap.cc:654] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.769901 30030 tablet_bootstrap.cc:492] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: No bootstrap required, opened a new log
I20260811 14:26:10.769963 30030 ts_tablet_manager.cc:1397] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:10.770064 30027 tablet_bootstrap.cc:492] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: No bootstrap required, opened a new log
I20260811 14:26:10.770090 30028 tablet_bootstrap.cc:492] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: No bootstrap required, opened a new log
I20260811 14:26:10.770138 30028 ts_tablet_manager.cc:1397] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:10.770141 30027 ts_tablet_manager.cc:1397] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:26:10.770104 30030 raft_consensus.cc:348] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.770179 30030 raft_consensus.cc:374] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.770215 30030 raft_consensus.cc:729] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.770258 30030 consensus_queue.cc:260] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.770280 30027 raft_consensus.cc:348] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.770285 30028 raft_consensus.cc:348] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.770349 30028 raft_consensus.cc:374] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.770349 30027 raft_consensus.cc:374] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.770361 30030 ts_tablet_manager.cc:1428] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:10.770376 30028 raft_consensus.cc:729] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7903d26487467abe681d74be7789a1, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.770375 30027 raft_consensus.cc:729] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b96e2bf22c4e6989ac3a67bc55945b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.770421 30028 consensus_queue.cc:260] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.770426 30027 consensus_queue.cc:260] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.770467 30038 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.770516 30027 ts_tablet_manager.cc:1428] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.770519 30028 ts_tablet_manager.cc:1428] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:10.770555 30038 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.770680 30033 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.770787 30033 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.770777 30035 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.770855 30035 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.788676 30038 raft_consensus.cc:482] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:10.788775 30038 raft_consensus.cc:504] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.788951 30038 leader_election.cc:288] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:10.789147 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a3a8208dd91409dad4ca10dcf590e63" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1" is_pre_election: true
I20260811 14:26:10.789186 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a3a8208dd91409dad4ca10dcf590e63" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" is_pre_election: true
I20260811 14:26:10.789255 29782 raft_consensus.cc:2454] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:10.789278 29629 raft_consensus.cc:2454] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:10.789417 29864 leader_election.cc:302] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 674a458a1df340f3b64b32478db36d8b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:10.789502 30038 raft_consensus.cc:2781] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:10.789543 30038 raft_consensus.cc:482] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:10.789566 30038 raft_consensus.cc:3037] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.790288 30038 raft_consensus.cc:504] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.790416 30038 leader_election.cc:288] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Requested vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:10.790546 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a3a8208dd91409dad4ca10dcf590e63" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
I20260811 14:26:10.790560 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a3a8208dd91409dad4ca10dcf590e63" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1"
I20260811 14:26:10.790634 29782 raft_consensus.cc:3037] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.790654 29629 raft_consensus.cc:3037] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:10.791214 29629 raft_consensus.cc:2454] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:10.791255 29782 raft_consensus.cc:2454] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:10.791412 29862 leader_election.cc:302] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b96e2bf22c4e6989ac3a67bc55945b, 674a458a1df340f3b64b32478db36d8b; no voters:
I20260811 14:26:10.791520 30038 raft_consensus.cc:2781] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:10.791599 30038 raft_consensus.cc:686] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Becoming Leader. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Running, Role: LEADER
I20260811 14:26:10.791668 30038 consensus_queue.cc:237] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.791972 30046 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: TxnStatusTablet state changed. Reason: New leader 674a458a1df340f3b64b32478db36d8b. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.792069 30046 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:26:10.792233 30077 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 14:26:10.792362 30077 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 14:26:10.792264 29449 catalog_manager.cc:5495] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 674a458a1df340f3b64b32478db36d8b (127.20.132.195). New cstate: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } health_report { overall_health: HEALTHY } } }
I20260811 14:26:10.800518 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.798238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.20.132.195:35563)
0811 14:26:10.798303 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.798304 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.798311 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:10.798328 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.798329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.798337 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.798400 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:10.798559 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.799075 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.799823 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.800013 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.800087 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.800269 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.800306 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.800364 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.800433 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.800454 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:26:10.800555 30069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.798015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35563 (local address 127.0.0.1:50844)
0811 14:26:10.798091 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.798103 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.798156 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.798426 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.798427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.798429 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:26:10.798476 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.798478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.799156 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.799157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.799735 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.799737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.800098 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.800099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.800171 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.800195 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.800379 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.800388 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.800431 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.800481 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 14:26:10.801496 29629 raft_consensus.cc:1261] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:10.801519 29782 raft_consensus.cc:1261] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:10.801713 30046 consensus_queue.cc:1035] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:10.801824 30038 consensus_queue.cc:1035] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:10.802330 30033 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: TxnStatusTablet state changed. Reason: New leader 674a458a1df340f3b64b32478db36d8b. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.802342 30035 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: TxnStatusTablet state changed. Reason: New leader 674a458a1df340f3b64b32478db36d8b. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.802423 30035 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.802424 30033 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.803186 30046 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.803262 30046 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:26:10.803341 30041 mvcc.cc:205] Tried to move back new op lower bound from 7317333486801293312 to 7317333486763118592. Current Snapshot: MvccSnapshot[applied={T|T < 7317333486801293312 or (T in {7317333486801293312})}]
I20260811 14:26:10.803354 30043 mvcc.cc:205] Tried to move back new op lower bound from 7317333486801293312 to 7317333486763118592. Current Snapshot: MvccSnapshot[applied={T|T < 7317333486801293312}]
I20260811 14:26:10.803503 30035 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.803580 30035 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P fc7903d26487467abe681d74be7789a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.804311 30046 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.804386 30046 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 674a458a1df340f3b64b32478db36d8b: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:26:10.804857 30033 tablet_replica.cc:439] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } } }
I20260811 14:26:10.804939 30033 tablet_replica.cc:442] T 6a3a8208dd91409dad4ca10dcf590e63 P 10b96e2bf22c4e6989ac3a67bc55945b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:26:10.807763 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.805060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44986 (local address 127.20.132.194:44037)
0811 14:26:10.805202 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.805204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.805212 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:10.805264 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.805265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.805286 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.805352 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:10.805493 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.806215 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.806915 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.807217 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.807288 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.807430 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.807553 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.807634 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.807657 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.807676 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 14:26:10.812866 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.810366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:52755 (local address 127.20.132.195:35563)
0811 14:26:10.810411 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.810413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.810513 (+ 100us) server_negotiation.cc:407] Connection header received
0811 14:26:10.810569 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.810570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.810579 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.810623 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:10.810757 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.811169 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.812282 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.812452 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.812507 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.812688 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.812712 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.812752 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.812804 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.812819 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 14:26:10.812951 30083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.810279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35563 (local address 127.20.132.194:52755)
0811 14:26:10.810441 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.810452 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.810513 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.810628 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.810629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.810631 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:26:10.810700 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.810702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.811255 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.811256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.812207 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.812210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.812523 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.812524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.812598 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.812613 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.812753 (+ 140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.812754 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.812802 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.812842 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
I20260811 14:26:10.815256 29629 raft_consensus.cc:1261] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Refusing update from remote peer fc7903d26487467abe681d74be7789a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:10.815294 29940 raft_consensus.cc:1261] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Refusing update from remote peer fc7903d26487467abe681d74be7789a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:10.815740 30062 consensus_queue.cc:1035] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:10.815900 30035 consensus_queue.cc:1035] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:10.824241 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.821633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:37075 (local address 127.20.132.194:44037)
0811 14:26:10.821673 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.821675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.821856 (+ 181us) server_negotiation.cc:407] Connection header received
0811 14:26:10.821917 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.821918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.821926 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.821970 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:10.822078 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.822520 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.823567 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.823744 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.823795 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.823978 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.824002 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.824034 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.824108 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.824123 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:26:10.824250 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.821554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:44037 (local address 127.20.132.195:37075)
0811 14:26:10.821749 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:10.821759 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:10.821854 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:10.821975 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:10.821976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:10.821977 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:26:10.822023 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.822025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.822602 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.822603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.823476 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:10.823478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.823822 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.823823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:10.823882 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.823898 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:26:10.824049 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:26:10.824051 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:26:10.824106 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 14:26:10.824168 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":92,"threads_started":1}
I20260811 14:26:10.833590 29449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:10.833714 29449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:10.834388 29449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Sending DeleteTablet for 3 replicas of tablet 21798650ac95429e9a8f90e98005d848
I20260811 14:26:10.834630 29762 tablet_service.cc:1514] Processing DeleteTablet for tablet 21798650ac95429e9a8f90e98005d848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:10 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:44972
I20260811 14:26:10.834663 29918 tablet_service.cc:1514] Processing DeleteTablet for tablet 21798650ac95429e9a8f90e98005d848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:10 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:50818
I20260811 14:26:10.834733 30056 tablet_replica.cc:330] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: stopping tablet replica
I20260811 14:26:10.834758 30055 tablet_replica.cc:330] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: stopping tablet replica
I20260811 14:26:10.834786 30056 raft_consensus.cc:2229] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:10.834817 30055 raft_consensus.cc:2229] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:10.834862 30055 raft_consensus.cc:2258] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:10.834872 30056 raft_consensus.cc:2258] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:10.834929 29605 tablet_service.cc:1514] Processing DeleteTablet for tablet 21798650ac95429e9a8f90e98005d848 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:10 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36778
I20260811 14:26:10.835016 30053 tablet_replica.cc:330] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: stopping tablet replica
I20260811 14:26:10.835057 30053 raft_consensus.cc:2229] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:10.835095 30053 raft_consensus.cc:2258] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:10.835253 30056 ts_tablet_manager.cc:1905] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:10.835425 30055 ts_tablet_manager.cc:1905] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:10.835451 30053 ts_tablet_manager.cc:1905] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:10.837046 30056 ts_tablet_manager.cc:1918] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:26:10.837108 30056 log.cc:1196] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/21798650ac95429e9a8f90e98005d848
I20260811 14:26:10.837132 30053 ts_tablet_manager.cc:1918] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:26:10.837189 30053 log.cc:1196] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/21798650ac95429e9a8f90e98005d848
I20260811 14:26:10.837340 30056 ts_tablet_manager.cc:1939] T 21798650ac95429e9a8f90e98005d848 P fc7903d26487467abe681d74be7789a1: Deleting consensus metadata
I20260811 14:26:10.837416 30053 ts_tablet_manager.cc:1939] T 21798650ac95429e9a8f90e98005d848 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting consensus metadata
I20260811 14:26:10.837651 29434 catalog_manager.cc:4841] TS fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037): tablet 21798650ac95429e9a8f90e98005d848 (table test-table [id=25ae9ec517bb40b5bcd7608ed909072a]) successfully deleted
I20260811 14:26:10.837730 29432 catalog_manager.cc:4841] TS 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381): tablet 21798650ac95429e9a8f90e98005d848 (table test-table [id=25ae9ec517bb40b5bcd7608ed909072a]) successfully deleted
I20260811 14:26:10.840827 30055 ts_tablet_manager.cc:1918] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:26:10.840889 30055 log.cc:1196] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/21798650ac95429e9a8f90e98005d848
I20260811 14:26:10.841110 30055 ts_tablet_manager.cc:1939] T 21798650ac95429e9a8f90e98005d848 P 674a458a1df340f3b64b32478db36d8b: Deleting consensus metadata
I20260811 14:26:10.841531 29434 catalog_manager.cc:4841] TS 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563): tablet 21798650ac95429e9a8f90e98005d848 (table test-table [id=25ae9ec517bb40b5bcd7608ed909072a]) successfully deleted
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:26:10.867295 30071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:10.860062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49172 (local address 127.20.132.254:42527)
0811 14:26:10.860122 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.860125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.860265 (+ 140us) server_negotiation.cc:407] Connection header received
0811 14:26:10.860325 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.860326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.860342 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.860418 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.861153 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.861992 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.863124 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.863445 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.863489 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.867191 (+ 3702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49172: BlockingRecv error: recv got EOF from 127.0.0.1:49172 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 14:26:10 dist-test-slave-cbbz krb5kdc[29398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM
I20260811 14:26:10.881240 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:10.868492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.20.132.254:42527)
0811 14:26:10.871372 (+ 2880us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:10.871374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:10.871384 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:10.871407 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:10.871408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:10.871424 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:10.871485 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:10.872896 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.873666 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.874787 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:10.875083 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:10.875126 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:10.878092 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:10.878093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:10.878093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:10.878101 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:10.879886 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.880321 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.880322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.880323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.880380 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:10.880617 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:10.880618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:10.880618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:10.880746 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:10.880833 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:10.881055 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 14:26:10.881140 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2837}
I20260811 14:26:10.883311 29449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:26:10.883489 29449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:10.884943 29918 tablet_service.cc:1467] Processing CreateTablet for tablet 18f25ff9e8974454838064729d6c3322 (DEFAULT_TABLE table=test-table [id=4cdeb32ba92e45279e6fcf93bde84cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.885089 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18f25ff9e8974454838064729d6c3322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.886456 30030 tablet_bootstrap.cc:492] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Bootstrap starting.
I20260811 14:26:10.886538 29762 tablet_service.cc:1467] Processing CreateTablet for tablet 18f25ff9e8974454838064729d6c3322 (DEFAULT_TABLE table=test-table [id=4cdeb32ba92e45279e6fcf93bde84cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.886670 29762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18f25ff9e8974454838064729d6c3322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.886794 30030 tablet_bootstrap.cc:654] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.887359 30030 tablet_bootstrap.cc:492] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: No bootstrap required, opened a new log
I20260811 14:26:10.887416 30030 ts_tablet_manager.cc:1397] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:10.887535 30030 raft_consensus.cc:348] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.887620 30030 raft_consensus.cc:374] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.887650 30030 raft_consensus.cc:729] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.887691 30030 consensus_queue.cc:260] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.887794 30030 ts_tablet_manager.cc:1428] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:10.887956 30028 tablet_bootstrap.cc:492] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Bootstrap starting.
I20260811 14:26:10.888396 30028 tablet_bootstrap.cc:654] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.888758 29605 tablet_service.cc:1467] Processing CreateTablet for tablet 18f25ff9e8974454838064729d6c3322 (DEFAULT_TABLE table=test-table [id=4cdeb32ba92e45279e6fcf93bde84cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:10.888898 29605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18f25ff9e8974454838064729d6c3322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:10.890178 30027 tablet_bootstrap.cc:492] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Bootstrap starting.
I20260811 14:26:10.890525 30027 tablet_bootstrap.cc:654] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:10.891855 30027 tablet_bootstrap.cc:492] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: No bootstrap required, opened a new log
I20260811 14:26:10.891911 30027 ts_tablet_manager.cc:1397] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 14:26:10.892052 30027 raft_consensus.cc:348] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.892122 30027 raft_consensus.cc:374] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.892170 30027 raft_consensus.cc:729] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b96e2bf22c4e6989ac3a67bc55945b, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.892210 30027 consensus_queue.cc:260] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.892313 30027 ts_tablet_manager.cc:1428] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:10.896723 30028 tablet_bootstrap.cc:492] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: No bootstrap required, opened a new log
I20260811 14:26:10.896785 30028 ts_tablet_manager.cc:1397] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260811 14:26:10.896917 30028 raft_consensus.cc:348] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.897017 30028 raft_consensus.cc:374] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:10.897037 30028 raft_consensus.cc:729] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7903d26487467abe681d74be7789a1, State: Initialized, Role: FOLLOWER
I20260811 14:26:10.897084 30028 consensus_queue.cc:260] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:10.897182 30028 ts_tablet_manager.cc:1428] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:11.054400 30038 raft_consensus.cc:482] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:11.054517 30038 raft_consensus.cc:504] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.054724 30038 leader_election.cc:288] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:11.055018 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f25ff9e8974454838064729d6c3322" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1" is_pre_election: true
I20260811 14:26:11.055047 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f25ff9e8974454838064729d6c3322" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" is_pre_election: true
I20260811 14:26:11.055137 29782 raft_consensus.cc:2454] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:11.055136 29629 raft_consensus.cc:2454] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:11.055313 29864 leader_election.cc:302] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 674a458a1df340f3b64b32478db36d8b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:11.055436 30038 raft_consensus.cc:2781] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:11.055495 30038 raft_consensus.cc:482] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:11.055527 30038 raft_consensus.cc:3037] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:11.056298 30038 raft_consensus.cc:504] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.056454 30038 leader_election.cc:288] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Requested vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:11.056638 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f25ff9e8974454838064729d6c3322" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1"
I20260811 14:26:11.056646 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18f25ff9e8974454838064729d6c3322" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
I20260811 14:26:11.056733 29629 raft_consensus.cc:3037] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:11.056737 29782 raft_consensus.cc:3037] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:11.057397 29629 raft_consensus.cc:2454] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:11.057405 29782 raft_consensus.cc:2454] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:11.057614 29862 leader_election.cc:302] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b96e2bf22c4e6989ac3a67bc55945b, 674a458a1df340f3b64b32478db36d8b; no voters:
I20260811 14:26:11.057736 30038 raft_consensus.cc:2781] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:11.057809 30038 raft_consensus.cc:686] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Becoming Leader. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Running, Role: LEADER
I20260811 14:26:11.057864 30038 consensus_queue.cc:237] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.058516 29449 catalog_manager.cc:5495] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 674a458a1df340f3b64b32478db36d8b (127.20.132.195). New cstate: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } health_report { overall_health: HEALTHY } } }
I20260811 14:26:11.076630 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:11.074119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50860 (local address 127.20.132.195:35563)
0811 14:26:11.074211 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:11.074214 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:11.074225 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:26:11.074274 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:11.074275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:11.074287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:11.074343 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:11.074511 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:11.075032 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:11.075905 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:11.076102 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:11.076201 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:11.076397 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:11.076423 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:11.076463 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:11.076512 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 14:26:11.076529 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:26:11.077479 29782 raft_consensus.cc:1261] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:11.077493 29629 raft_consensus.cc:1261] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:11.077693 30089 consensus_queue.cc:1035] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:11.077792 30038 consensus_queue.cc:1035] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:11.080132 29449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:11.080265 29449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:11.080911 29449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Sending DeleteTablet for 3 replicas of tablet 18f25ff9e8974454838064729d6c3322
I20260811 14:26:11.081137 29605 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f25ff9e8974454838064729d6c3322 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:11 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36778
I20260811 14:26:11.081161 29762 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f25ff9e8974454838064729d6c3322 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:11 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:44972
I20260811 14:26:11.081215 29918 tablet_service.cc:1514] Processing DeleteTablet for tablet 18f25ff9e8974454838064729d6c3322 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:11 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:50818
I20260811 14:26:11.081243 30053 tablet_replica.cc:330] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: stopping tablet replica
I20260811 14:26:11.081290 30053 raft_consensus.cc:2229] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:11.081331 30053 raft_consensus.cc:2258] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:11.081350 30055 tablet_replica.cc:330] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: stopping tablet replica
I20260811 14:26:11.081404 30056 tablet_replica.cc:330] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: stopping tablet replica
I20260811 14:26:11.081419 30055 raft_consensus.cc:2229] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:11.081465 30056 raft_consensus.cc:2229] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:11.081473 30055 raft_consensus.cc:2258] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:11.081521 30056 raft_consensus.cc:2258] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:11.081506 29449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:26:11.081652 29449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:11.081817 30055 ts_tablet_manager.cc:1905] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:11.082026 30053 ts_tablet_manager.cc:1905] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:11.082036 30056 ts_tablet_manager.cc:1905] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:11.082907 29918 tablet_service.cc:1467] Processing CreateTablet for tablet 11fdbcf63c984fc0a78678bd3281e6c1 (DEFAULT_TABLE table=test-table [id=02b683abd8e74caa9126253a1a798a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:11.083019 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11fdbcf63c984fc0a78678bd3281e6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:11.083541 30055 ts_tablet_manager.cc:1918] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:11.083577 30056 ts_tablet_manager.cc:1918] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:11.083596 30055 log.cc:1196] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/18f25ff9e8974454838064729d6c3322
I20260811 14:26:11.083626 30056 log.cc:1196] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/18f25ff9e8974454838064729d6c3322
I20260811 14:26:11.083689 30053 ts_tablet_manager.cc:1918] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:11.083748 30053 log.cc:1196] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/18f25ff9e8974454838064729d6c3322
I20260811 14:26:11.083849 30056 ts_tablet_manager.cc:1939] T 18f25ff9e8974454838064729d6c3322 P fc7903d26487467abe681d74be7789a1: Deleting consensus metadata
I20260811 14:26:11.083849 30055 ts_tablet_manager.cc:1939] T 18f25ff9e8974454838064729d6c3322 P 674a458a1df340f3b64b32478db36d8b: Deleting consensus metadata
I20260811 14:26:11.083989 30053 ts_tablet_manager.cc:1939] T 18f25ff9e8974454838064729d6c3322 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting consensus metadata
I20260811 14:26:11.084193 29434 catalog_manager.cc:4841] TS 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563): tablet 18f25ff9e8974454838064729d6c3322 (table test-table [id=4cdeb32ba92e45279e6fcf93bde84cd5]) successfully deleted
I20260811 14:26:11.084379 30030 tablet_bootstrap.cc:492] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Bootstrap starting.
I20260811 14:26:11.084460 29434 catalog_manager.cc:4841] TS fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037): tablet 18f25ff9e8974454838064729d6c3322 (table test-table [id=4cdeb32ba92e45279e6fcf93bde84cd5]) successfully deleted
I20260811 14:26:11.084661 29432 catalog_manager.cc:4841] TS 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381): tablet 18f25ff9e8974454838064729d6c3322 (table test-table [id=4cdeb32ba92e45279e6fcf93bde84cd5]) successfully deleted
I20260811 14:26:11.084733 30030 tablet_bootstrap.cc:654] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:11.084772 29605 tablet_service.cc:1467] Processing CreateTablet for tablet 11fdbcf63c984fc0a78678bd3281e6c1 (DEFAULT_TABLE table=test-table [id=02b683abd8e74caa9126253a1a798a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:11.084877 29605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11fdbcf63c984fc0a78678bd3281e6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:11.084990 29762 tablet_service.cc:1467] Processing CreateTablet for tablet 11fdbcf63c984fc0a78678bd3281e6c1 (DEFAULT_TABLE table=test-table [id=02b683abd8e74caa9126253a1a798a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:11.085088 29762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11fdbcf63c984fc0a78678bd3281e6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:11.086077 30027 tablet_bootstrap.cc:492] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: Bootstrap starting.
I20260811 14:26:11.086239 30028 tablet_bootstrap.cc:492] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Bootstrap starting.
I20260811 14:26:11.086531 30028 tablet_bootstrap.cc:654] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:11.086550 30030 tablet_bootstrap.cc:492] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: No bootstrap required, opened a new log
I20260811 14:26:11.086591 30030 ts_tablet_manager.cc:1397] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:26:11.086719 30030 raft_consensus.cc:348] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.086793 30030 raft_consensus.cc:374] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:11.086814 30030 raft_consensus.cc:729] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Initialized, Role: FOLLOWER
I20260811 14:26:11.086862 30030 consensus_queue.cc:260] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.086901 30027 tablet_bootstrap.cc:654] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:11.086957 30030 ts_tablet_manager.cc:1428] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:11.087218 30028 tablet_bootstrap.cc:492] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: No bootstrap required, opened a new log
I20260811 14:26:11.087271 30028 ts_tablet_manager.cc:1397] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:11.087380 30028 raft_consensus.cc:348] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.087464 30028 raft_consensus.cc:374] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:11.087491 30028 raft_consensus.cc:729] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7903d26487467abe681d74be7789a1, State: Initialized, Role: FOLLOWER
I20260811 14:26:11.087543 30028 consensus_queue.cc:260] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.087667 30028 ts_tablet_manager.cc:1428] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:11.087824 30027 tablet_bootstrap.cc:492] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: No bootstrap required, opened a new log
I20260811 14:26:11.087888 30027 ts_tablet_manager.cc:1397] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:26:11.088037 30027 raft_consensus.cc:348] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.088115 30027 raft_consensus.cc:374] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:11.088183 30027 raft_consensus.cc:729] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b96e2bf22c4e6989ac3a67bc55945b, State: Initialized, Role: FOLLOWER
I20260811 14:26:11.088250 30027 consensus_queue.cc:260] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.088346 30027 ts_tablet_manager.cc:1428] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:11.258661 30036 raft_consensus.cc:482] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:11.258769 30036 raft_consensus.cc:504] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.258961 30036 leader_election.cc:288] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:11.259219 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11fdbcf63c984fc0a78678bd3281e6c1" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1" is_pre_election: true
I20260811 14:26:11.259219 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11fdbcf63c984fc0a78678bd3281e6c1" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" is_pre_election: true
I20260811 14:26:11.259325 29782 raft_consensus.cc:2454] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:11.259325 29629 raft_consensus.cc:2454] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 0.
I20260811 14:26:11.259488 29864 leader_election.cc:302] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 674a458a1df340f3b64b32478db36d8b, fc7903d26487467abe681d74be7789a1; no voters:
I20260811 14:26:11.259639 30036 raft_consensus.cc:2781] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:11.259701 30036 raft_consensus.cc:482] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:11.259740 30036 raft_consensus.cc:3037] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:11.260512 30036 raft_consensus.cc:504] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.260658 30036 leader_election.cc:288] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Requested vote from peers 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381), fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037)
I20260811 14:26:11.260809 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11fdbcf63c984fc0a78678bd3281e6c1" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7903d26487467abe681d74be7789a1"
I20260811 14:26:11.260828 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11fdbcf63c984fc0a78678bd3281e6c1" candidate_uuid: "674a458a1df340f3b64b32478db36d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b96e2bf22c4e6989ac3a67bc55945b"
I20260811 14:26:11.260885 29782 raft_consensus.cc:3037] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:11.260906 29629 raft_consensus.cc:3037] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:11.261492 29629 raft_consensus.cc:2454] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:11.261617 29782 raft_consensus.cc:2454] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 674a458a1df340f3b64b32478db36d8b in term 1.
I20260811 14:26:11.261729 29862 leader_election.cc:302] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b96e2bf22c4e6989ac3a67bc55945b, 674a458a1df340f3b64b32478db36d8b; no voters:
I20260811 14:26:11.261830 30036 raft_consensus.cc:2781] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:11.261881 30036 raft_consensus.cc:686] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Becoming Leader. State: Replica: 674a458a1df340f3b64b32478db36d8b, State: Running, Role: LEADER
I20260811 14:26:11.261937 30036 consensus_queue.cc:237] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } }
I20260811 14:26:11.262575 29449 catalog_manager.cc:5495] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 674a458a1df340f3b64b32478db36d8b (127.20.132.195). New cstate: current_term: 1 leader_uuid: "674a458a1df340f3b64b32478db36d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "674a458a1df340f3b64b32478db36d8b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35563 } health_report { overall_health: HEALTHY } } }
I20260811 14:26:11.272683 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:11.270387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35563 (local address 127.20.132.195:45905)
0811 14:26:11.270445 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:11.270458 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:11.270528 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:11.270651 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:11.270651 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:11.270652 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:26:11.270707 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:11.270708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:11.271302 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:11.271303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:11.271851 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:11.271853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:11.272247 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:11.272248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:11.272300 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:11.272305 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:26:11.272510 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:26:11.272512 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:26:11.272560 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 14:26:11.272603 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:26:11.272683 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:11.270476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:45905 (local address 127.20.132.195:35563)
0811 14:26:11.270527 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:11.270530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:11.270539 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:11.270582 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:11.270583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:11.270593 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:11.270655 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:11.270754 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:11.271223 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:11.271935 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:11.272182 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:11.272239 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:11.272384 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:11.272432 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:11.272495 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:11.272565 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 14:26:11.272583 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":31}
I20260811 14:26:11.274719 29629 raft_consensus.cc:1261] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:11.274781 29782 raft_consensus.cc:1261] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Refusing update from remote peer 674a458a1df340f3b64b32478db36d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:11.274943 30036 consensus_queue.cc:1035] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b96e2bf22c4e6989ac3a67bc55945b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:11.275049 30089 consensus_queue.cc:1035] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7903d26487467abe681d74be7789a1" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:11.285966 29449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:11.286075 29449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:11.286717 29449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb4b9f60ee1423cb5722f454f50a8a5: Sending DeleteTablet for 3 replicas of tablet 11fdbcf63c984fc0a78678bd3281e6c1
I20260811 14:26:11.286984 29605 tablet_service.cc:1514] Processing DeleteTablet for tablet 11fdbcf63c984fc0a78678bd3281e6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:11 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36778
I20260811 14:26:11.286988 29762 tablet_service.cc:1514] Processing DeleteTablet for tablet 11fdbcf63c984fc0a78678bd3281e6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:11 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:44972
I20260811 14:26:11.287074 30056 tablet_replica.cc:330] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: stopping tablet replica
I20260811 14:26:11.287053 29917 tablet_service.cc:1514] Processing DeleteTablet for tablet 11fdbcf63c984fc0a78678bd3281e6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:11 UTC) from {username='oryx', principal='oryx/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:50818
I20260811 14:26:11.287094 30053 tablet_replica.cc:330] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: stopping tablet replica
I20260811 14:26:11.287128 30056 raft_consensus.cc:2229] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:11.287165 30053 raft_consensus.cc:2229] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:11.287182 30056 raft_consensus.cc:2258] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:11.287185 30055 tablet_replica.cc:330] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: stopping tablet replica
I20260811 14:26:11.287205 30053 raft_consensus.cc:2258] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:11.287242 30055 raft_consensus.cc:2229] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:11.287300 30055 raft_consensus.cc:2258] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:11.287614 30053 ts_tablet_manager.cc:1905] T 11fdbcf63c984fc0a78678bd3281e6c1 P 10b96e2bf22c4e6989ac3a67bc55945b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:11.287629 30055 ts_tablet_manager.cc:1905] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:11.287674 30056 ts_tablet_manager.cc:1905] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:11.287704 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 29533
I20260811 14:26:11.289650 30055 ts_tablet_manager.cc:1918] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:26:11.289734 30055 log.cc:1196] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/11fdbcf63c984fc0a78678bd3281e6c1
I20260811 14:26:11.289964 30055 ts_tablet_manager.cc:1939] T 11fdbcf63c984fc0a78678bd3281e6c1 P 674a458a1df340f3b64b32478db36d8b: Deleting consensus metadata
I20260811 14:26:11.290315 29434 catalog_manager.cc:4841] TS 674a458a1df340f3b64b32478db36d8b (127.20.132.195:35563): tablet 11fdbcf63c984fc0a78678bd3281e6c1 (table test-table [id=02b683abd8e74caa9126253a1a798a6c]) successfully deleted
I20260811 14:26:11.293066 30056 ts_tablet_manager.cc:1918] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:26:11.293118 30056 log.cc:1196] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/11fdbcf63c984fc0a78678bd3281e6c1
I20260811 14:26:11.293324 30056 ts_tablet_manager.cc:1939] T 11fdbcf63c984fc0a78678bd3281e6c1 P fc7903d26487467abe681d74be7789a1: Deleting consensus metadata
I20260811 14:26:11.293630 29434 catalog_manager.cc:4841] TS fc7903d26487467abe681d74be7789a1 (127.20.132.194:44037): tablet 11fdbcf63c984fc0a78678bd3281e6c1 (table test-table [id=02b683abd8e74caa9126253a1a798a6c]) successfully deleted
W20260811 14:26:11.297341 29432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:44381 (error 108)
I20260811 14:26:11.297554 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 29691
I20260811 14:26:11.300733 30120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:11.300502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44381 (local address 127.0.0.1:36788)
0811 14:26:11.300599 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:11.300685 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:44381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":39,"threads_started":1}
W20260811 14:26:11.300881 29432 catalog_manager.cc:4584] TS 10b96e2bf22c4e6989ac3a67bc55945b (127.20.132.193:44381): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 11fdbcf63c984fc0a78678bd3281e6c1: Network error: Client connection negotiation failed: client connection to 127.20.132.193:44381: connect: Connection refused (error 111)
I20260811 14:26:11.305377 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 29845
I20260811 14:26:11.314733 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 29412
2026-08-11T14:26:11Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2984 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:11 dist-test-slave-cbbz krb5kdc[30124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:11 dist-test-slave-cbbz krb5kdc[30124](info): set up 2 sockets
Aug 11 14:26:11 dist-test-slave-cbbz krb5kdc[30124](info): commencing operation
krb5kdc: starting...
W20260811 14:26:12.411639 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:12 dist-test-slave-cbbz krb5kdc[30124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:26:12.531036 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45223
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:32925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:45223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:12.614580 30138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:12.614825 30138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:12.614862 30138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:12.616016 30138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:12.616091 30138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:12.616118 30138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:12.616186 30138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:12.616219 30138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:12.617700 30138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:32925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:45223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:12.617973 30138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:12.618201 30138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:12.623014 30148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:12.623030 30145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:12.623065 30144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:12.623415 30138 server_base.cc:1034] running on GCE node
I20260811 14:26:12.623648 30138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:12.623965 30138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:12.625128 30138 hybrid_clock.cc:648] HybridClock initialized: now 1786458372625119 us; error 45 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T14:26:12Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1311 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:12 dist-test-slave-cbbz krb5kdc[30154](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:12 dist-test-slave-cbbz krb5kdc[30154](info): set up 2 sockets
Aug 11 14:26:12 dist-test-slave-cbbz krb5kdc[30154](info): commencing operation
krb5kdc: starting...
W20260811 14:26:13.739498 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:13 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:26:13.862684 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:36883
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:36883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:13.943660 30168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:13.943859 30168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:13.943882 30168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:13.945065 30168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:13.945109 30168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:13.945124 30168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:13.945137 30168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:13.945179 30168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:13.946641 30168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:36883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:36883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:13.946882 30168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:13.947105 30168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:13.951813 30173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:13.951824 30175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:13.951855 30177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:13.951933 30168 server_base.cc:1034] running on GCE node
I20260811 14:26:13.952312 30168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:13.952674 30168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:13.953860 30168 hybrid_clock.cc:648] HybridClock initialized: now 1786458373953841 us; error 29 us; skew 500 ppm
Aug 11 14:26:13 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458373, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:13.956588 30168 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:26:13.957069 30168 webserver.cc:460] Webserver started at http://127.20.132.254:41229/ using document root <none> and password file <none>
I20260811 14:26:13.957312 30168 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:13.957386 30168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:13.957546 30168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:13.958640 30168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "cb3440b3268d46a79f0bc4de52374681"
format_stamp: "Formatted at 2026-08-11 14:26:13 on dist-test-slave-cbbz"
server_key: "132d61e3dbe77db78691d932611c91bd"
server_key_iv: "e52c07efb252f530ec0931cb80c287dd"
server_key_version: "encryptionkey@0"
I20260811 14:26:13.959039 30168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "cb3440b3268d46a79f0bc4de52374681"
format_stamp: "Formatted at 2026-08-11 14:26:13 on dist-test-slave-cbbz"
server_key: "132d61e3dbe77db78691d932611c91bd"
server_key_iv: "e52c07efb252f530ec0931cb80c287dd"
server_key_version: "encryptionkey@0"
I20260811 14:26:13.960464 30168 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:13.961190 30184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:13.961351 30168 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:13.961462 30168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "cb3440b3268d46a79f0bc4de52374681"
format_stamp: "Formatted at 2026-08-11 14:26:13 on dist-test-slave-cbbz"
server_key: "132d61e3dbe77db78691d932611c91bd"
server_key_iv: "e52c07efb252f530ec0931cb80c287dd"
server_key_version: "encryptionkey@0"
I20260811 14:26:13.961547 30168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:13.992198 30168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:13.994616 30168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:13.994779 30168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:13.998984 30168 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:36883
I20260811 14:26:13.999022 30244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:36883 every 8 connection(s)
I20260811 14:26:13.999402 30168 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:14.000273 30245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:14.002552 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Bootstrap starting.
I20260811 14:26:14.003178 30245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:14.003489 30245 log.cc:824] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:14.004261 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: No bootstrap required, opened a new log
I20260811 14:26:14.005843 30245 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.005975 30245 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:14.005998 30245 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3440b3268d46a79f0bc4de52374681, State: Initialized, Role: FOLLOWER
I20260811 14:26:14.006178 30245 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.006242 30245 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:14.006264 30245 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:14.006316 30245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:14.006804 30245 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.006886 30245 leader_election.cc:302] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb3440b3268d46a79f0bc4de52374681; no voters:
I20260811 14:26:14.007053 30245 leader_election.cc:288] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:14.007171 30248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:14.007536 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 30168
I20260811 14:26:14.007647 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:14.007853 21011 external_mini_cluster.cc:1428] Setting key 39074bc9f1cd579dacbbf3184b36bb97
I20260811 14:26:14.007349 30248 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 LEADER]: Becoming Leader. State: Replica: cb3440b3268d46a79f0bc4de52374681, State: Running, Role: LEADER
I20260811 14:26:14.007417 30245 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:14.008066 30248 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.009217 30249 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb3440b3268d46a79f0bc4de52374681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } } }
I20260811 14:26:14.009232 30250 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb3440b3268d46a79f0bc4de52374681. Latest consensus state: current_term: 1 leader_uuid: "cb3440b3268d46a79f0bc4de52374681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } } }
I20260811 14:26:14.009347 30249 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:14.009380 30250 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:14.009578 30260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:14.010077 30260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:14.012955 30260 catalog_manager.cc:1347] Generated new cluster ID: 6d236c3b0eb1410d929be1285a9d0b3d
I20260811 14:26:14.013012 30260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:14.018311 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.008564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37150 (local address 127.20.132.254:36883)
0811 14:26:14.008745 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.008754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.008783 (+ 29us) server_negotiation.cc:407] Connection header received
0811 14:26:14.008903 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.008911 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.008975 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.009130 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.009998 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.011055 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.011798 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.012429 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.012541 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.015046 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:14.015050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:14.015050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:14.015068 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:14.016777 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.017143 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.017147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.017148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.017245 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.017467 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.017468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.017468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.017708 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:14.017887 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:14.017953 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 14:26:14.018106 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":75,"threads_started":1}
I20260811 14:26:14.034041 30260 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:14.034596 30260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:14.037155 30260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Generated new TSK 0
I20260811 14:26:14.037334 30260 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:26:14.074761 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:36883
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:14.167256 30274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:14.167486 30274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:14.167529 30274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:14.168803 30274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:14.168867 30274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:14.168915 30274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:14.170378 30274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:36883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:14.170639 30274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:14.170881 30274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:26:14.175824 30274 server_base.cc:1034] running on GCE node
W20260811 14:26:14.175806 30279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.175804 30280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.175832 30283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.176357 30274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:14.176573 30274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:14.177722 30274 hybrid_clock.cc:648] HybridClock initialized: now 1786458374177700 us; error 40 us; skew 500 ppm
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:14.180261 30274 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:26:14.180683 30274 webserver.cc:460] Webserver started at http://127.20.132.193:35691/ using document root <none> and password file <none>
I20260811 14:26:14.180932 30274 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:14.181001 30274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:14.181151 30274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:14.182228 30274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "94d2286b96bf4fa7b23e8d9e54e46cfd"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0eb255160dd178f63f9f5a78adfe7c16"
server_key_iv: "d7284f140fe6aca038e94520d6dc8a99"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.182591 30274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "94d2286b96bf4fa7b23e8d9e54e46cfd"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0eb255160dd178f63f9f5a78adfe7c16"
server_key_iv: "d7284f140fe6aca038e94520d6dc8a99"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.183919 30274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:26:14.184744 30292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.184914 30274 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.185006 30274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "94d2286b96bf4fa7b23e8d9e54e46cfd"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0eb255160dd178f63f9f5a78adfe7c16"
server_key_iv: "d7284f140fe6aca038e94520d6dc8a99"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.185088 30274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:14.205892 30274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:14.208072 30274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:14.208267 30274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:14.208526 30274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:14.208940 30274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:14.208997 30274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.209031 30274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:14.209061 30274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.214996 30274 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:43507
I20260811 14:26:14.215065 30420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:43507 every 8 connection(s)
I20260811 14:26:14.215371 30274 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:14.220355 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 30274
I20260811 14:26:14.220471 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:14.220707 21011 external_mini_cluster.cc:1428] Setting key 24987f3c27fb52dc15b5705287d4563c
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:14.225350 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.216034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:37925)
0811 14:26:14.216229 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:14.216270 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:14.216747 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:14.216968 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:14.216971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:14.217542 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:14.217741 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.217746 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.218435 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.218436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.219259 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.219262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.219615 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.219616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.219722 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.220267 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:14.220277 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:14.222093 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:14.223949 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:14.223956 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:14.223957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:14.224257 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:14.224469 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:14.224469 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:14.224469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:14.224568 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:14.224863 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:14.224867 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:14.224979 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 14:26:14.225055 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:26:14.225191 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":131,"threads_started":1}
I20260811 14:26:14.225368 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.216053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:37925 (local address 127.20.132.254:36883)
0811 14:26:14.216174 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.216176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.216367 (+ 191us) server_negotiation.cc:407] Connection header received
0811 14:26:14.216838 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.216839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.216849 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.216906 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.217827 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.218329 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.219346 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.219540 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.219592 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.222192 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:14.222194 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:14.222194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:14.222202 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:14.223858 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.224332 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.224333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.224334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.224398 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.224645 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.224646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.224647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.224802 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:14.224869 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:14.225114 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 14:26:14.225228 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:26:14.225909 30421 heartbeater.cc:347] Connected to a master server at 127.20.132.254:36883
I20260811 14:26:14.226022 30421 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:14.226246 30421 heartbeater.cc:511] Master 127.20.132.254:36883 requested a full tablet report, sending...
I20260811 14:26:14.226822 30202 ts_manager.cc:194] Registered new tserver with Master: 94d2286b96bf4fa7b23e8d9e54e46cfd (127.20.132.193:43507)
I20260811 14:26:14.227440 30202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:37925
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:26:14.246996 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:36883
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:14.328413 30427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:14.328641 30427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:14.328679 30427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:14.329867 30427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:14.329936 30427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:14.329983 30427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:14.331395 30427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:36883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:14.331664 30427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:14.331890 30427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:14.336740 30435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.336748 30438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.336756 30434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.337042 30427 server_base.cc:1034] running on GCE node
I20260811 14:26:14.337280 30427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:14.337455 30427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:14.338587 30427 hybrid_clock.cc:648] HybridClock initialized: now 1786458374338578 us; error 27 us; skew 500 ppm
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:14.341235 30427 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:26:14.341632 30427 webserver.cc:460] Webserver started at http://127.20.132.194:38089/ using document root <none> and password file <none>
I20260811 14:26:14.341881 30427 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:14.341925 30427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:14.342144 30427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:14.343192 30427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "877a9a2e2ab04f5799eae36d1259c10e"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0436ddc140730d42bac490f287948a4c"
server_key_iv: "f6d7307899a49423cb5345e1d83db02f"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.343533 30427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "877a9a2e2ab04f5799eae36d1259c10e"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0436ddc140730d42bac490f287948a4c"
server_key_iv: "f6d7307899a49423cb5345e1d83db02f"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.344970 30427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:26:14.345701 30446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.345872 30427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.345969 30427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "877a9a2e2ab04f5799eae36d1259c10e"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0436ddc140730d42bac490f287948a4c"
server_key_iv: "f6d7307899a49423cb5345e1d83db02f"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.346051 30427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:14.360322 30427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:14.362581 30427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:14.362743 30427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:14.362967 30427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:14.363263 30427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:14.363317 30427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.363371 30427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:14.363399 30427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.369340 30427 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:41053
I20260811 14:26:14.369416 30583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:41053 every 8 connection(s)
I20260811 14:26:14.369735 30427 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:14.372620 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 30427
I20260811 14:26:14.372736 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:14.372928 21011 external_mini_cluster.cc:1428] Setting key 2e1cf7eb6a59276890eebad8adbea066
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:14.380626 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.370458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:40035 (local address 127.20.132.254:36883)
0811 14:26:14.370505 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.370507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.370750 (+ 243us) server_negotiation.cc:407] Connection header received
0811 14:26:14.371270 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.371271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.371284 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.371335 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.372344 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.373153 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.374507 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.374709 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.374759 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.377378 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:14.377379 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:14.377379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:14.377385 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:14.379172 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.379565 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.379566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.379567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.379633 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.379867 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.379868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.379868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.380026 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:14.380105 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:14.380434 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 14:26:14.380519 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:14.380645 30586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.370445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:40035)
0811 14:26:14.370621 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:14.370654 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:14.371165 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:14.371411 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:14.371415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:14.371981 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:14.372246 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.372252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.373274 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.373275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.374411 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.374414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.374785 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.374787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.374946 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.375458 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:14.375470 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:14.377282 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:14.379269 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:14.379276 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:14.379277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:14.379485 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:14.379707 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:14.379707 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:14.379708 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:14.379800 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:14.380098 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:14.380102 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:14.380289 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 14:26:14.380385 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 14:26:14.380496 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
I20260811 14:26:14.381194 30584 heartbeater.cc:347] Connected to a master server at 127.20.132.254:36883
I20260811 14:26:14.381310 30584 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:14.381515 30584 heartbeater.cc:511] Master 127.20.132.254:36883 requested a full tablet report, sending...
I20260811 14:26:14.381938 30202 ts_manager.cc:194] Registered new tserver with Master: 877a9a2e2ab04f5799eae36d1259c10e (127.20.132.194:41053)
I20260811 14:26:14.382319 30202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:40035
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:26:14.402410 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:36883
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:14.485270 30590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:14.485466 30590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:14.485489 30590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:14.486567 30590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:14.486600 30590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:14.486626 30590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:14.488108 30590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:36883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:14.488305 30590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:14.488471 30590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:14.493281 30596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.493275 30597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.493342 30590 server_base.cc:1034] running on GCE node
W20260811 14:26:14.493296 30599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.493729 30590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:14.493988 30590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:14.495155 30590 hybrid_clock.cc:648] HybridClock initialized: now 1786458374495141 us; error 26 us; skew 500 ppm
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:14.497694 30590 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:26:14.498169 30590 webserver.cc:460] Webserver started at http://127.20.132.195:33345/ using document root <none> and password file <none>
I20260811 14:26:14.498395 30590 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:14.498463 30590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:14.498618 30590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:14.499662 30590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "e2b2e41760f9459a847b64c1f1a475a3"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "001481ddc80a3d4abe1276f9323c9d10"
server_key_iv: "e77d3770189505fcac7c6f24a02b15c7"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.500032 30590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "e2b2e41760f9459a847b64c1f1a475a3"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "001481ddc80a3d4abe1276f9323c9d10"
server_key_iv: "e77d3770189505fcac7c6f24a02b15c7"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.501374 30590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:14.502130 30606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.502305 30590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.502401 30590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "e2b2e41760f9459a847b64c1f1a475a3"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "001481ddc80a3d4abe1276f9323c9d10"
server_key_iv: "e77d3770189505fcac7c6f24a02b15c7"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.502483 30590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:14.513290 30590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:14.515069 30590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:14.515239 30590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:14.515481 30590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:14.515781 30590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:14.515842 30590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.515883 30590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:14.515908 30590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.522322 30590 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:35831
I20260811 14:26:14.522367 30729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:35831 every 8 connection(s)
I20260811 14:26:14.522687 30590 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:14.527642 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 30590
I20260811 14:26:14.527742 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:14.527922 21011 external_mini_cluster.cc:1428] Setting key 2a3eabf7e220176094385cd31816b73a
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:14.532383 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.523411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47949 (local address 127.20.132.254:36883)
0811 14:26:14.523456 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.523463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.523667 (+ 204us) server_negotiation.cc:407] Connection header received
0811 14:26:14.524191 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.524192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.524203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.524256 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.525195 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.525679 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.526610 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.526794 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.526844 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.529249 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:14.529251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:14.529251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:14.529259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:14.530663 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.531082 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.531083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.531084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.531141 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:14.531586 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:14.531588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:14.531588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:14.531743 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:14.531830 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:14.532193 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 14:26:14.532286 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:26:14.532591 30733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.523362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:47949)
0811 14:26:14.523536 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:14.523577 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:14.524067 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:14.524321 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:14.524324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:14.524911 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:14.525114 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.525119 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.525765 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.525765 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.526537 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.526539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.526867 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.526868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.526962 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.527392 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:14.527400 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:14.529148 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:14.530767 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:14.530774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:14.530776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:14.531003 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:14.531241 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:14.531242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:14.531242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:14.531453 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:14.531837 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:14.531845 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:14.531989 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 14:26:14.532131 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 14:26:14.532337 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260811 14:26:14.533082 30731 heartbeater.cc:347] Connected to a master server at 127.20.132.254:36883
I20260811 14:26:14.533205 30731 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:14.533398 30731 heartbeater.cc:511] Master 127.20.132.254:36883 requested a full tablet report, sending...
I20260811 14:26:14.533805 30202 ts_manager.cc:194] Registered new tserver with Master: e2b2e41760f9459a847b64c1f1a475a3 (127.20.132.195:35831)
I20260811 14:26:14.534181 30202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:47949
I20260811 14:26:14.539844 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab.
Entry for principal oryx/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab.
WARNING: no policy specified for oryx/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab.
Entry for principal oryx/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab.
WARNING: no policy specified for oryx/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab.
Entry for principal oryx/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab.
I20260811 14:26:14.614915 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 30274
I20260811 14:26:14.621147 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 30427
I20260811 14:26:14.629316 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 30590
I20260811 14:26:14.635131 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 30168
I20260811 14:26:14.643365 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:36883
--webserver_interface=127.20.132.254
--webserver_port=41229
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:36883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:14.725754 30740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:14.725939 30740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:14.725961 30740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:14.727121 30740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:14.727161 30740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:14.727176 30740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:14.727188 30740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:14.727242 30740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:14.728717 30740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:36883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:36883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=41229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:14.728955 30740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:14.729192 30740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:14.734153 30749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.734292 30740 server_base.cc:1034] running on GCE node
W20260811 14:26:14.734138 30751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.734136 30747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.734623 30740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:14.734943 30740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:14.736128 30740 hybrid_clock.cc:648] HybridClock initialized: now 1786458374736105 us; error 35 us; skew 500 ppm
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:14.738790 30740 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:26:14.739228 30740 webserver.cc:460] Webserver started at http://127.20.132.254:41229/ using document root <none> and password file <none>
I20260811 14:26:14.739455 30740 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:14.739542 30740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:14.741061 30740 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:14.741737 30759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.741923 30740 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:14.742020 30740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "cb3440b3268d46a79f0bc4de52374681"
format_stamp: "Formatted at 2026-08-11 14:26:13 on dist-test-slave-cbbz"
server_key: "132d61e3dbe77db78691d932611c91bd"
server_key_iv: "e52c07efb252f530ec0931cb80c287dd"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.742365 30740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:14.782035 30740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:14.783957 30740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:14.784178 30740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:14.787971 30740 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:36883
I20260811 14:26:14.788010 30818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:36883 every 8 connection(s)
I20260811 14:26:14.788429 30740 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:14.789354 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 30740
I20260811 14:26:14.789664 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:43507
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:36883
--webserver_port=35691
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:26:14.790040 30819 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:26:14.790681 30819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Bootstrap starting.
I20260811 14:26:14.799664 30819 log.cc:824] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:14.801400 30819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:26:14.801716 30819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Bootstrap complete.
I20260811 14:26:14.804023 30819 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.804306 30819 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3440b3268d46a79f0bc4de52374681, State: Initialized, Role: FOLLOWER
I20260811 14:26:14.804486 30819 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.804549 30819 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:14.804608 30819 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:14.804658 30819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:26:14.805711 30819 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.805796 30819 leader_election.cc:302] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb3440b3268d46a79f0bc4de52374681; no voters:
I20260811 14:26:14.806023 30819 leader_election.cc:288] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 14:26:14.806059 30826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:26:14.806197 30826 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [term 2 LEADER]: Becoming Leader. State: Replica: cb3440b3268d46a79f0bc4de52374681, State: Running, Role: LEADER
I20260811 14:26:14.806316 30819 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:14.806366 30826 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } }
I20260811 14:26:14.806656 30826 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb3440b3268d46a79f0bc4de52374681. Latest consensus state: current_term: 2 leader_uuid: "cb3440b3268d46a79f0bc4de52374681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } } }
I20260811 14:26:14.806761 30826 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:14.806658 30828 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cb3440b3268d46a79f0bc4de52374681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3440b3268d46a79f0bc4de52374681" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36883 } } }
I20260811 14:26:14.807058 30828 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:14.807204 30833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:14.807711 30833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:14.808040 30833 catalog_manager.cc:1259] Loaded cluster ID: 6d236c3b0eb1410d929be1285a9d0b3d
I20260811 14:26:14.808082 30833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:14.809297 30833 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:14.809466 30833 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cb3440b3268d46a79f0bc4de52374681: Loaded TSK: 0
I20260811 14:26:14.809674 30833 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:26:14.874305 30822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:14.874512 30822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:14.874536 30822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:14.875715 30822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:14.875757 30822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:14.875783 30822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:14.877213 30822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.193.keytab
--principal=oryx/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:43507
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=35691
--tserver_master_addrs=127.20.132.254:36883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:14.877442 30822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:14.877727 30822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:26:14.883654 30822 server_base.cc:1034] running on GCE node
W20260811 14:26:14.883630 30852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.883638 30854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:14.883867 30851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:14.884099 30822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:14.884388 30822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:14.885551 30822 hybrid_clock.cc:648] HybridClock initialized: now 1786458374885528 us; error 42 us; skew 500 ppm
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458374, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:14.898541 30822 init.cc:377] Logged in from keytab as oryx/127.20.132.193@KRBTEST.COM (short username oryx)
I20260811 14:26:14.899096 30822 webserver.cc:460] Webserver started at http://127.20.132.193:35691/ using document root <none> and password file <none>
I20260811 14:26:14.899348 30822 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:14.899402 30822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:14.900875 30822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:26:14.901492 30863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.901685 30822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:14.901793 30822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "94d2286b96bf4fa7b23e8d9e54e46cfd"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0eb255160dd178f63f9f5a78adfe7c16"
server_key_iv: "d7284f140fe6aca038e94520d6dc8a99"
server_key_version: "encryptionkey@0"
I20260811 14:26:14.902139 30822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:14.910476 30822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:14.912667 30822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:14.912809 30822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:14.913084 30822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:14.913458 30822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:14.913496 30822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.913517 30822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:14.913530 30822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:14.921022 30822 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:43507
I20260811 14:26:14.921062 31007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:43507 every 8 connection(s)
I20260811 14:26:14.921438 30822 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:14.925562 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 30822
I20260811 14:26:14.925890 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:41053
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:36883
--webserver_port=38089
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:14.931569 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.922213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:46809)
0811 14:26:14.922395 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:14.922445 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:14.923394 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:14.923927 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:14.923931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:14.924370 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:14.924583 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.924589 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.926314 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.926315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.927638 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.927642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.928294 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.928295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.928429 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.929012 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:14.929019 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:14.931337 (+ 2318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
W20260811 14:26:14.931816 31008 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:36883 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.132.254:36883: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
W20260811 14:26:14.931607 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:14.922341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:46809 (local address 127.20.132.254:36883)
0811 14:26:14.922549 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.922558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.922600 (+ 42us) server_negotiation.cc:407] Connection header received
0811 14:26:14.923630 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.923637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.923706 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.923856 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.924721 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.926174 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.927724 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.928132 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.928320 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.931461 (+ 3141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:46809: BlockingRecv error: recv got EOF from 127.20.132.193:46809 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":91,"threads_started":1}
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:14.936465 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.932032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:33935)
0811 14:26:14.932261 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:14.932271 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:14.932323 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:14.932454 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:14.932454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:14.932595 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:14.932641 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.932642 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.933277 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.933278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.933778 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.933780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.934150 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.934150 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.934222 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.934677 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:14.934686 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:14.936383 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213}
W20260811 14:26:14.936524 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:14.932124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:33935 (local address 127.20.132.254:36883)
0811 14:26:14.932238 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.932240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.932307 (+ 67us) server_negotiation.cc:407] Connection header received
0811 14:26:14.932383 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.932384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.932398 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.932452 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.932723 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.933195 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.933873 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.934081 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.934152 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.936459 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:33935: BlockingRecv error: recv got EOF from 127.20.132.193:33935 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":102,"threads_started":1}
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:14 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:14.941310 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:14.936961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:54465)
0811 14:26:14.937071 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:14.937082 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:14.937129 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:14.937255 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:14.937256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:14.937383 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:14.937407 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.937408 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.938024 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.938025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.938509 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:14.938510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.938898 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.938898 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:14.938952 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.939388 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:14.939393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:14.941229 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94}
W20260811 14:26:14.941361 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:14.937012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:54465 (local address 127.20.132.254:36883)
0811 14:26:14.937076 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:14.937078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:14.937113 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:26:14.937185 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:14.937186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:14.937196 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:14.937251 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:14.937488 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.937944 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.938615 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:14.938815 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:14.938896 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:14.941300 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:54465: BlockingRecv error: recv got EOF from 127.20.132.193:54465 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 14:26:14.941584 31008 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:26:15.011634 31012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:15.011847 31012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:15.011871 31012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:15.013058 31012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:15.013099 31012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:15.013126 31012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:15.014540 31012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.194.keytab
--principal=oryx/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:41053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=38089
--tserver_master_addrs=127.20.132.254:36883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:15.014788 31012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:15.015024 31012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:15.020257 31018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:15.020268 31021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:15.020289 31012 server_base.cc:1034] running on GCE node
W20260811 14:26:15.020285 31019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:15.020670 31012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:15.020924 31012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:15.022089 31012 hybrid_clock.cc:648] HybridClock initialized: now 1786458375022089 us; error 43 us; skew 500 ppm
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458375, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:15.024653 31012 init.cc:377] Logged in from keytab as oryx/127.20.132.194@KRBTEST.COM (short username oryx)
I20260811 14:26:15.025102 31012 webserver.cc:460] Webserver started at http://127.20.132.194:38089/ using document root <none> and password file <none>
I20260811 14:26:15.025341 31012 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:15.025429 31012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:15.026803 31012 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:15.027380 31029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.027547 31012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.027647 31012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "877a9a2e2ab04f5799eae36d1259c10e"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "0436ddc140730d42bac490f287948a4c"
server_key_iv: "f6d7307899a49423cb5345e1d83db02f"
server_key_version: "encryptionkey@0"
I20260811 14:26:15.028000 31012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:15.038561 31012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:15.040954 31012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:15.041118 31012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:15.041383 31012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:15.041702 31012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:15.041759 31012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.041812 31012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:15.041839 31012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.048285 31012 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:41053
I20260811 14:26:15.048360 31160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:41053 every 8 connection(s)
I20260811 14:26:15.048735 31012 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:15.051973 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31012
I20260811 14:26:15.052306 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:35831
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:36883
--webserver_port=33345
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:26:15.056892 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.049531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:38511 (local address 127.20.132.254:36883)
0811 14:26:15.049618 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.049620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.049802 (+ 182us) server_negotiation.cc:407] Connection header received
0811 14:26:15.050341 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.050342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.050355 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.050411 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.051319 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.051807 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.053316 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.053501 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.053571 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.056833 (+ 3262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:38511: BlockingRecv error: recv got EOF from 127.20.132.194:38511 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:26:15.056957 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.049486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:38511)
0811 14:26:15.049681 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.049717 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.050253 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.050473 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.050476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.051045 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.051246 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.051251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.051897 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.051899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.053230 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.053233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.053598 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.053599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.053758 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.054448 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.054456 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.056751 (+ 2295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":111,"threads_started":1}
W20260811 14:26:15.057219 31161 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:36883 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.132.254:36883: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:15.062399 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.057477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:45437)
0811 14:26:15.057525 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.057536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.057574 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.057716 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.057717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.057885 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.057942 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.057944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.058534 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.058535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.059453 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.059456 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.059786 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.059787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.059867 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.060337 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.060343 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.062304 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 14:26:15.062427 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.057534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:45437 (local address 127.20.132.254:36883)
0811 14:26:15.057572 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.057573 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.057582 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:15.057631 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.057631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.057639 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.057687 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.058017 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.058455 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.059544 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.059716 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.059760 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.062384 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:45437: BlockingRecv error: recv got EOF from 127.20.132.194:45437 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:15.067144 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.062654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:40551)
0811 14:26:15.062794 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.062806 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.062858 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.062996 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.062997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.063158 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.063194 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.063196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.063759 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.063760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.064663 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.064666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.064985 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.064986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.065042 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.065383 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.065388 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.067075 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
W20260811 14:26:15.067205 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.062701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:40551 (local address 127.20.132.254:36883)
0811 14:26:15.062730 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.062732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.062858 (+ 126us) server_negotiation.cc:407] Connection header received
0811 14:26:15.062917 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.062918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.062926 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.062974 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.063264 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.063683 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.064746 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.064913 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.064964 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.067140 (+ 2176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:40551: BlockingRecv error: recv got EOF from 127.20.132.194:40551 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260811 14:26:15.067253 31161 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:26:15.138134 31164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:15.138319 31164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:15.138341 31164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:15.139421 31164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:15.139456 31164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:15.139482 31164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:15.140951 31164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/krb5kdc/oryx_127.20.132.195.keytab
--principal=oryx/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:35831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=33345
--tserver_master_addrs=127.20.132.254:36883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:15.141144 31164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:15.141319 31164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:15.146358 31171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:15.146353 31173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:15.146396 31170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:15.146719 31164 server_base.cc:1034] running on GCE node
I20260811 14:26:15.146944 31164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:15.147190 31164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:15.148384 31164 hybrid_clock.cc:648] HybridClock initialized: now 1786458375148363 us; error 31 us; skew 500 ppm
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458375, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:15.151022 31164 init.cc:377] Logged in from keytab as oryx/127.20.132.195@KRBTEST.COM (short username oryx)
I20260811 14:26:15.151412 31164 webserver.cc:460] Webserver started at http://127.20.132.195:33345/ using document root <none> and password file <none>
I20260811 14:26:15.151588 31164 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:15.151643 31164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:15.153028 31164 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:15.153558 31181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.153760 31164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.153854 31164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "e2b2e41760f9459a847b64c1f1a475a3"
format_stamp: "Formatted at 2026-08-11 14:26:14 on dist-test-slave-cbbz"
server_key: "001481ddc80a3d4abe1276f9323c9d10"
server_key_iv: "e77d3770189505fcac7c6f24a02b15c7"
server_key_version: "encryptionkey@0"
I20260811 14:26:15.154201 31164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:15.171000 31164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:15.173017 31164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:15.173188 31164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:15.173426 31164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:15.173743 31164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:15.173799 31164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.173840 31164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:15.173868 31164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:15.180567 31164 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:35831
I20260811 14:26:15.180616 31310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:35831 every 8 connection(s)
I20260811 14:26:15.180960 31164 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:26:15.188109 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.181674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:37905 (local address 127.20.132.254:36883)
0811 14:26:15.181732 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.181735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.181990 (+ 255us) server_negotiation.cc:407] Connection header received
0811 14:26:15.182474 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.182475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.182485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.182538 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.183439 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.183915 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.185090 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.185289 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.185371 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.188054 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:37905: BlockingRecv error: recv got EOF from 127.20.132.195:37905 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:26:15.188109 31313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.181669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:37905)
0811 14:26:15.181858 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.181896 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.182389 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.182589 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.182592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.183169 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.183360 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.183365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.183995 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.183996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.184865 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.184867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.185385 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.185385 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.185483 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.185924 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.185931 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.187972 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":103,"threads_started":1}
W20260811 14:26:15.188460 31311 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:36883 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.132.254:36883: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
I20260811 14:26:15.188767 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31164
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:15.193104 31313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.188689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:33901)
0811 14:26:15.188738 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.188748 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.188789 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.189042 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.189043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.189227 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.189280 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.189282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.189899 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.189900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.190395 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.190396 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.190772 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.190773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.190838 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.191249 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.191254 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.193035 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 14:26:15.193130 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.188889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:33901 (local address 127.20.132.254:36883)
0811 14:26:15.188927 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.188929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.188936 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:15.188956 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.188957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.188972 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.189039 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.189360 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.189819 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.190490 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.190689 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.190770 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.193090 (+ 2320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:33901: BlockingRecv error: recv got EOF from 127.20.132.195:33901 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:26:15.196295 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.189181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37154 (local address 127.20.132.254:36883)
0811 14:26:15.189254 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.189256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.189410 (+ 154us) server_negotiation.cc:407] Connection header received
0811 14:26:15.189492 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.189493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.189506 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.189569 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.190163 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.190629 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.191418 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.191616 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.191692 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.193048 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:15.193052 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:15.193053 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:15.193064 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:15.194732 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:15.195122 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:15.195124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:15.195124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:15.195219 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:15.195447 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:15.195448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:15.195448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:15.195747 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:15.195886 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:15.196044 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 14:26:15.196180 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:15.197889 31313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.193551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:36067)
0811 14:26:15.193651 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.193662 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.193710 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.193823 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.193824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.193946 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.193968 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.193969 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.194551 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.194552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.195223 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.195226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.195684 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.195685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.195722 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.196168 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.196173 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.197850 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 14:26:15.198004 31011 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.193609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:36067 (local address 127.20.132.254:36883)
0811 14:26:15.193662 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.193665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.193695 (+ 30us) server_negotiation.cc:407] Connection header received
0811 14:26:15.193765 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.193766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.193775 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.193822 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.194042 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.194471 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.195355 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.195610 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.195679 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.197938 (+ 2259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:36067: BlockingRecv error: recv got EOF from 127.20.132.195:36067 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 14:26:15.198117 31311 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:15 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:15.947395 31315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:15.941984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:44125)
0811 14:26:15.942153 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:15.942164 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:15.942232 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:15.942366 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:15.942367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:15.942624 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:15.942696 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.942698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.943665 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.943666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.944294 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:15.944296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.944655 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.944656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:15.944696 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.945241 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:15.945246 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:15.947316 (+ 2070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
W20260811 14:26:15.947537 31316 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:15.942081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:44125 (local address 127.20.132.254:36883)
0811 14:26:15.942213 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:15.942215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:15.942225 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:15.942281 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:15.942281 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:15.942291 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:15.942351 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:15.942836 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.943595 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.944376 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:15.944588 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:15.944646 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:15.947418 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:44125: BlockingRecv error: recv got EOF from 127.20.132.193:44125 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
Aug 11 14:26:16 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:16 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:16.072619 31317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:16.067640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:36961)
0811 14:26:16.067843 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:16.067856 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:16.067927 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:16.068099 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:16.068100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:16.068322 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:16.068373 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:16.068374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.069048 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.069050 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:16.069621 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:16.069623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.070011 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.070012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:16.070076 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:16.070572 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:16.070577 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:16.072509 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":92,"threads_started":1}
W20260811 14:26:16.072664 31316 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:16.067757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:36961 (local address 127.20.132.254:36883)
0811 14:26:16.067832 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:16.067834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:16.067905 (+ 71us) server_negotiation.cc:407] Connection header received
0811 14:26:16.067990 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:16.067991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:16.068005 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:16.068076 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:16.068460 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.068961 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.069717 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.069920 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.070008 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:16.072598 (+ 2590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:36961: BlockingRecv error: recv got EOF from 127.20.132.194:36961 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 14:26:16 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:16 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:16.203327 31318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:16.198544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:36907)
0811 14:26:16.198725 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:16.198737 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:16.198811 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:16.198941 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:16.198942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:16.199117 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:16.199168 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:16.199170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.199795 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.199796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:16.200440 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:16.200442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.200762 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.200763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:16.200807 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:16.201250 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:16.201255 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:16.203255 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":125,"threads_started":1}
W20260811 14:26:16.203387 31316 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:16.198627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:36907 (local address 127.20.132.254:36883)
0811 14:26:16.198697 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:16.198699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:16.198813 (+ 114us) server_negotiation.cc:407] Connection header received
0811 14:26:16.198853 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:16.198853 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:16.198866 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:16.198922 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:16.199235 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.199720 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.200516 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.200695 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.200749 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:16.203340 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:36907: BlockingRecv error: recv got EOF from 127.20.132.195:36907 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 14:26:16 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:16 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:16.952364 31319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:16.947827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:54313)
0811 14:26:16.947991 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:16.948002 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:16.948056 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:16.948243 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:16.948244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:16.948414 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:16.948463 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:16.948464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.949080 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.949081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:16.949638 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:16.949639 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.950007 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.950008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:16.950046 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:16.950498 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:16.950503 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:16.952306 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
W20260811 14:26:16.952515 31320 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:16.947901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:54313 (local address 127.20.132.254:36883)
0811 14:26:16.948027 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:16.948029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:16.948046 (+ 17us) server_negotiation.cc:407] Connection header received
0811 14:26:16.948110 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:16.948110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:16.948123 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:16.948233 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:16.948525 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.949016 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.949707 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:16.949938 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:16.949995 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:16.952426 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:54313: BlockingRecv error: recv got EOF from 127.20.132.193:54313 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
Aug 11 14:26:17 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:17 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:17.077785 31321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:17.073228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:54537)
0811 14:26:17.073389 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:17.073400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:17.073470 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:17.073617 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:17.073617 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:17.073800 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:17.073852 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:17.073853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.074530 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.074531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:17.075057 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:17.075058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.075408 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.075408 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:17.075450 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:17.075903 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:17.075907 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:17.077726 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
W20260811 14:26:17.077958 31320 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:17.073331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:54537 (local address 127.20.132.254:36883)
0811 14:26:17.073388 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:17.073390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:17.073476 (+ 86us) server_negotiation.cc:407] Connection header received
0811 14:26:17.073522 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:17.073522 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:17.073532 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:17.073592 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:17.073928 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.074441 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.075147 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.075337 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.075393 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:17.077859 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:54537: BlockingRecv error: recv got EOF from 127.20.132.194:54537 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 14:26:17 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:17 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:17.209045 31322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:17.203851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:34713)
0811 14:26:17.204009 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:17.204020 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:17.204074 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:17.204232 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:17.204233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:17.204407 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:17.204458 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:17.204460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.205168 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.205170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:17.205827 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:17.205833 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.206189 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.206191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:17.206239 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:17.206805 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:17.206812 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:17.208952 (+ 2140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
W20260811 14:26:17.209132 31320 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:17.203981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:34713 (local address 127.20.132.254:36883)
0811 14:26:17.204055 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:17.204057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:17.204067 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:17.204160 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:17.204160 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:17.204174 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:17.204228 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:17.204516 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.205055 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.205924 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.206121 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.206171 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:17.209053 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:34713: BlockingRecv error: recv got EOF from 127.20.132.195:34713 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 14:26:17 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:17 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:17.957839 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:17.952857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:57491)
0811 14:26:17.953038 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:17.953051 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:17.953124 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:17.953255 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:17.953256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:17.953434 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:17.953487 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:17.953488 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.954127 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.954128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:17.954682 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:17.954683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.955095 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.955096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:17.955138 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:17.955645 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:17.955649 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:17.957778 (+ 2129us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
W20260811 14:26:17.958057 31324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:17.952952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:57491 (local address 127.20.132.254:36883)
0811 14:26:17.953057 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:17.953059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:17.953120 (+ 61us) server_negotiation.cc:407] Connection header received
0811 14:26:17.953168 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:17.953169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:17.953181 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:17.953239 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:17.953569 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.954046 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.954772 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:17.955025 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:17.955086 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:17.957966 (+ 2880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:57491: BlockingRecv error: recv got EOF from 127.20.132.193:57491 (error 108)
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":51,"threads_started":1}
Aug 11 14:26:18 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:18 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:18.083204 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:18.078338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:55321)
0811 14:26:18.078477 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:18.078488 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:18.078548 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:18.078705 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:18.078706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:18.078880 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:18.078933 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:18.078935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.079646 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.079647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:18.080201 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:18.080203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.080596 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.080597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:18.080650 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:18.081129 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:18.081134 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:18.083099 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
W20260811 14:26:18.083256 31324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:18.078401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:55321 (local address 127.20.132.254:36883)
0811 14:26:18.078488 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:18.078491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:18.078550 (+ 59us) server_negotiation.cc:407] Connection header received
0811 14:26:18.078612 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:18.078612 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:18.078624 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:18.078678 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:18.079035 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.079559 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.080293 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.080491 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.080569 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:18.083187 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:55321: BlockingRecv error: recv got EOF from 127.20.132.194:55321 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 14:26:18 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:18 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:18.214367 31326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:18.209540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:40289)
0811 14:26:18.209722 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:18.209740 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:18.209825 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:18.209984 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:18.209985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:18.210188 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:18.210237 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:18.210239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.210918 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.210919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:18.211470 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:18.211472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.211854 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.211855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:18.211923 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:18.212480 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:18.212485 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:18.214306 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":97,"threads_started":1}
W20260811 14:26:18.214542 31324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:18.209631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:40289 (local address 127.20.132.254:36883)
0811 14:26:18.209704 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:18.209707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:18.209805 (+ 98us) server_negotiation.cc:407] Connection header received
0811 14:26:18.209901 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:18.209902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:18.209917 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:18.209964 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:18.210313 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.210824 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.211560 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.211778 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.211855 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:18.214421 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:40289: BlockingRecv error: recv got EOF from 127.20.132.195:40289 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 14:26:18 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:18 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:18.963223 31327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:18.958399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:57035)
0811 14:26:18.958576 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:18.958587 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:18.958668 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:18.958817 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:18.958817 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:18.958986 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:18.959036 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:18.959038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.959736 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.959737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:18.960443 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:18.960447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.960825 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.960826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:18.960870 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:18.961370 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:18.961374 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:18.963166 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
W20260811 14:26:18.963374 31328 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:18.958481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:57035 (local address 127.20.132.254:36883)
0811 14:26:18.958617 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:18.958619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:18.958649 (+ 30us) server_negotiation.cc:407] Connection header received
0811 14:26:18.958728 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:18.958728 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:18.958740 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:18.958799 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:18.959141 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.959663 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.960540 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:18.960740 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:18.960800 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:18.963278 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:57035: BlockingRecv error: recv got EOF from 127.20.132.193:57035 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":57,"threads_started":1}
Aug 11 14:26:19 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:19 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:19.088795 31329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:19.083766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:41237)
0811 14:26:19.083978 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:19.083990 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:19.084067 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:19.084247 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:19.084248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:19.084447 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:19.084497 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:19.084498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.085190 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.085191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:19.085725 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:19.085726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.086102 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.086103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:19.086173 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:19.086837 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:19.086842 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:19.088700 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":120,"threads_started":1}
W20260811 14:26:19.088853 31328 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:19.083883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:41237 (local address 127.20.132.254:36883)
0811 14:26:19.083966 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:19.083969 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:19.084043 (+ 74us) server_negotiation.cc:407] Connection header received
0811 14:26:19.084128 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:19.084129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:19.084168 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:19.084237 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:19.084581 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.085097 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.085812 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.086011 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.086099 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:19.088791 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:41237: BlockingRecv error: recv got EOF from 127.20.132.194:41237 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 14:26:19 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:19 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:19.219669 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:19.214858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:55581)
0811 14:26:19.215033 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:19.215047 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:19.215110 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:19.215248 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:19.215249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:19.215414 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:19.215465 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:19.215466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.216111 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.216112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:19.216777 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:19.216781 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.217198 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.217199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:19.217255 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:19.217768 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:19.217776 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:19.219567 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":116,"threads_started":1}
W20260811 14:26:19.219705 31328 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:19.214968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:55581 (local address 127.20.132.254:36883)
0811 14:26:19.215035 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:19.215037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:19.215096 (+ 59us) server_negotiation.cc:407] Connection header received
0811 14:26:19.215157 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:19.215158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:19.215170 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:19.215228 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:19.215531 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.216040 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.216863 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.217117 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.217197 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:19.219645 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:55581: BlockingRecv error: recv got EOF from 127.20.132.195:55581 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 14:26:19 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:19 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:19.973299 31332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:19.963745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:55959)
0811 14:26:19.963907 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:19.963918 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:19.963994 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:19.964238 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:19.964239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:19.964493 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:19.964560 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:19.964562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.965376 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.965377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:19.965902 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:19.965903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.966318 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.966319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:19.966362 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:19.971310 (+ 4948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:19.971314 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:19.973230 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
W20260811 14:26:19.973496 31333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:19.963834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:55959 (local address 127.20.132.254:36883)
0811 14:26:19.963988 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:19.963990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:19.964000 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:19.964067 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:19.964068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:19.964108 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:19.964200 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:19.964689 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.965295 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.966008 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:19.966241 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:19.966305 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:19.973370 (+ 7065us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:55959: BlockingRecv error: recv got EOF from 127.20.132.193:55959 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
Aug 11 14:26:20 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:20 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:20.094228 31334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:20.089319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:46949)
0811 14:26:20.089512 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:20.089525 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:20.089609 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:20.089762 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:20.089763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:20.089929 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:20.089980 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:20.089981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.090689 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.090691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:20.091241 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:20.091243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.091584 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.091585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:20.091629 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:20.092099 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:20.092104 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:20.094169 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
W20260811 14:26:20.094362 31333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:20.089486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:46949 (local address 127.20.132.254:36883)
0811 14:26:20.089560 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:20.089562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:20.089587 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:26:20.089674 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:20.089675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:20.089686 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:20.089739 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:20.090098 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.090608 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.091326 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.091515 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.091575 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:20.094279 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:46949: BlockingRecv error: recv got EOF from 127.20.132.194:46949 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 14:26:20 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:20 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:20.225333 31335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:20.220258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:36665)
0811 14:26:20.220440 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:20.220452 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:20.220547 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:20.220736 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:20.220737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:20.220922 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:20.220971 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:20.220974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.221674 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.221675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:20.222390 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:20.222393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.222772 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.222773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:20.222831 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:20.223350 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:20.223355 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:20.225235 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
W20260811 14:26:20.225375 31333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:20.220359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:36665 (local address 127.20.132.254:36883)
0811 14:26:20.220440 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:20.220443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:20.220531 (+ 88us) server_negotiation.cc:407] Connection header received
0811 14:26:20.220642 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:20.220643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:20.220657 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:20.220730 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:20.221068 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.221567 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.222469 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.222682 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.222770 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:20.225312 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:36665: BlockingRecv error: recv got EOF from 127.20.132.195:36665 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 14:26:20 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:20 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:20.978652 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:20.973822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:34257)
0811 14:26:20.973972 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:20.973984 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:20.974060 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:20.974185 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:20.974186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:20.974348 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:20.974397 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:20.974398 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.975064 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.975065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:20.975613 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:20.975615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.975988 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.975989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:20.976033 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:20.976545 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:20.976567 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:20.978589 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":64,"threads_started":1}
W20260811 14:26:20.978775 31337 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:20.973863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:34257 (local address 127.20.132.254:36883)
0811 14:26:20.973990 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:20.973992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:20.974059 (+ 67us) server_negotiation.cc:407] Connection header received
0811 14:26:20.974111 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:20.974112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:20.974123 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:20.974181 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:20.974461 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.974977 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.975700 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:20.975910 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:20.975984 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:20.978694 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:34257: BlockingRecv error: recv got EOF from 127.20.132.193:34257 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":82,"threads_started":1}
Aug 11 14:26:21 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:21 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:21.099892 31339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:21.094780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:35147)
0811 14:26:21.094936 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:21.094955 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:21.095071 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:21.095258 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:21.095259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:21.095449 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:21.095501 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:21.095503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.096226 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.096228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:21.096758 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:21.096760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.097251 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.097252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:21.097319 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:21.097883 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:21.097889 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:21.099788 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
W20260811 14:26:21.099944 31337 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:21.094936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:35147 (local address 127.20.132.254:36883)
0811 14:26:21.095014 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:21.095016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:21.095026 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:21.095161 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:21.095162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:21.095177 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:21.095247 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:21.095597 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.096099 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.096859 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.097168 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.097253 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:21.099878 (+ 2625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:35147: BlockingRecv error: recv got EOF from 127.20.132.194:35147 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 14:26:21 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:21 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:21.231104 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:21.225837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:41259)
0811 14:26:21.226040 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:21.226055 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:21.226153 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:21.226334 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:21.226335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:21.226516 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:21.226566 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:21.226568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.227263 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.227264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:21.228014 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:21.228017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.228445 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.228446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:21.228505 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:21.229046 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:21.229051 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:21.231038 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":111,"threads_started":1}
W20260811 14:26:21.231316 31337 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:21.225943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:41259 (local address 127.20.132.254:36883)
0811 14:26:21.226023 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:21.226025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:21.226134 (+ 109us) server_negotiation.cc:407] Connection header received
0811 14:26:21.226240 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:21.226241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:21.226254 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:21.226328 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:21.226653 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.227174 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.228123 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.228340 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.228432 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:21.231133 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:41259: BlockingRecv error: recv got EOF from 127.20.132.195:41259 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 14:26:21 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:21 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:21.983615 31341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:21.979155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:50731)
0811 14:26:21.979315 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:21.979326 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:21.979385 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:21.979521 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:21.979521 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:21.979700 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:21.979752 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:21.979753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.980411 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.980412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:21.980940 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:21.980941 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.981264 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.981265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:21.981305 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:21.981762 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:21.981777 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:21.983552 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
W20260811 14:26:21.983801 31342 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:21.979233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:50731 (local address 127.20.132.254:36883)
0811 14:26:21.979374 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:21.979376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:21.979385 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:21.979432 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:21.979432 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:21.979442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:21.979506 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:21.979817 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.980345 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.981010 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:21.981200 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:21.981250 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:21.983687 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:50731: BlockingRecv error: recv got EOF from 127.20.132.193:50731 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
Aug 11 14:26:22 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:22 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:22.105399 31344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:22.100442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:46193)
0811 14:26:22.100595 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:22.100604 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:22.100647 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:22.100826 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:22.100827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:22.100995 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:22.101047 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:22.101048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.101741 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.101742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:22.102278 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:22.102280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.102621 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.102622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:22.102660 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:22.103146 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:22.103150 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:22.105332 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":75,"threads_started":1}
W20260811 14:26:22.105502 31342 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:22.100605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:46193 (local address 127.20.132.254:36883)
0811 14:26:22.100695 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:22.100697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:22.100706 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:22.100731 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:22.100731 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:22.100743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:22.100811 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:22.101123 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.101664 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.102357 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.102554 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.102613 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:22.105429 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:46193: BlockingRecv error: recv got EOF from 127.20.132.194:46193 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 14:26:22 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:22 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:22.236814 31345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:22.231667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:57981)
0811 14:26:22.231807 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:22.231819 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:22.231912 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:22.232063 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:22.232064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:22.232261 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:22.232318 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:22.232320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.233091 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.233093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:22.233926 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:22.233929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.234333 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.234334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:22.234372 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:22.234912 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:22.234918 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:22.236755 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
W20260811 14:26:22.236912 31342 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:22.231744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:57981 (local address 127.20.132.254:36883)
0811 14:26:22.231804 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:22.231806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:22.231910 (+ 104us) server_negotiation.cc:407] Connection header received
0811 14:26:22.231961 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:22.231962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:22.231978 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:22.232038 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:22.232382 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.232915 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.233994 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.234267 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.234323 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:22.236842 (+ 2519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:57981: BlockingRecv error: recv got EOF from 127.20.132.195:57981 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 14:26:22 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:22 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:22.988649 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:22.984180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:48625)
0811 14:26:22.984353 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:22.984364 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:22.984415 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:22.984530 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:22.984531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:22.984693 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:22.984739 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:22.984740 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.985410 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.985410 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:22.985914 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:22.985915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.986252 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.986253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:22.986292 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:22.986712 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:22.986716 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:22.988566 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":88,"threads_started":1}
W20260811 14:26:22.988756 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:22.984296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:48625 (local address 127.20.132.254:36883)
0811 14:26:22.984426 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:22.984427 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:22.984435 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:22.984457 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:22.984457 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:22.984467 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:22.984526 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:22.984808 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.985341 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.985981 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:22.986188 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:22.986239 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:22.988657 (+ 2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:48625: BlockingRecv error: recv got EOF from 127.20.132.193:48625 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
Aug 11 14:26:23 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:23 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:23.111069 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:23.105877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:54611)
0811 14:26:23.106168 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:23.106178 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:23.106238 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:23.106364 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:23.106365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:23.106612 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:23.106663 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:23.106665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.107491 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.107492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:23.108193 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:23.108196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.108505 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.108506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:23.108550 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:23.109049 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:23.109054 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:23.111012 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":209,"threads_started":1}
W20260811 14:26:23.111198 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:23.106066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:54611 (local address 127.20.132.254:36883)
0811 14:26:23.106114 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:23.106116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:23.106252 (+ 136us) server_negotiation.cc:407] Connection header received
0811 14:26:23.106282 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:23.106283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:23.106295 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:23.106347 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:23.106729 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.107406 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.108253 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.108439 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.108492 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:23.111126 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:54611: BlockingRecv error: recv got EOF from 127.20.132.194:54611 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 14:26:23 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:23 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:23.242887 31349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:23.237411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:33719)
0811 14:26:23.237674 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:23.237687 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:23.237760 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:23.237897 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:23.237897 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:23.238066 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:23.238136 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:23.238138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.238980 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.238981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:23.239557 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:23.239560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.239933 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.239935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:23.239995 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:23.240555 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:23.240566 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:23.242801 (+ 2235us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":77,"threads_started":1}
W20260811 14:26:23.242973 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:23.237486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:33719 (local address 127.20.132.254:36883)
0811 14:26:23.237695 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:23.237698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:23.237758 (+ 60us) server_negotiation.cc:407] Connection header received
0811 14:26:23.237818 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:23.237819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:23.237832 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:23.237878 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:23.238203 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.238886 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.239646 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.239855 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.239933 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:23.242923 (+ 2990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:33719: BlockingRecv error: recv got EOF from 127.20.132.195:33719 (error 108)
Metrics: {"server-negotiator.queue_time_us":183}
Aug 11 14:26:23 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:23 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:23.993885 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:23.989192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:42899)
0811 14:26:23.989425 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:23.989438 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:23.989507 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:23.989672 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:23.989672 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:23.989844 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:23.989895 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:23.989897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.990521 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.990522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:23.991033 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:23.991034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.991365 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.991366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:23.991406 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:23.991920 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:23.991925 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:23.993825 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":144,"threads_started":1}
W20260811 14:26:23.994043 31351 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:23.989377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:42899 (local address 127.20.132.254:36883)
0811 14:26:23.989543 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:23.989545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:23.989552 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:23.989573 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:23.989573 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:23.989584 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:23.989650 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:23.989963 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.990455 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.991103 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:23.991294 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:23.991354 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:23.993944 (+ 2590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:42899: BlockingRecv error: recv got EOF from 127.20.132.193:42899 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
Aug 11 14:26:24 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:24 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:24.116477 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:24.111599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:56347)
0811 14:26:24.111750 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:24.111768 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:24.111837 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:24.112008 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:24.112010 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:24.112227 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:24.112279 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:24.112281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.112972 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.112973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:24.113544 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:24.113547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.113882 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.113883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:24.113947 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:24.114428 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:24.114433 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:24.116410 (+ 1977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
W20260811 14:26:24.116616 31351 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:24.111696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:56347 (local address 127.20.132.254:36883)
0811 14:26:24.111753 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:24.111755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:24.111859 (+ 104us) server_negotiation.cc:407] Connection header received
0811 14:26:24.111886 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:24.111887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:24.111901 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:24.111960 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:24.112356 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.112879 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.113627 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.113811 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.113865 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:24.116526 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:56347: BlockingRecv error: recv got EOF from 127.20.132.194:56347 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 14:26:24 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:24 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:24.248579 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:24.243425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:45691)
0811 14:26:24.243634 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:24.243651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:24.243730 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:24.243883 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:24.243885 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:24.244073 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:24.244123 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:24.244125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.244806 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.244807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:24.245354 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:24.245357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.245726 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.245726 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:24.245794 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:24.246289 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:24.246294 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:24.248511 (+ 2217us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":129,"threads_started":1}
W20260811 14:26:24.248734 31351 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:24.243519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:45691 (local address 127.20.132.254:36883)
0811 14:26:24.243601 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:24.243604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:24.243712 (+ 108us) server_negotiation.cc:407] Connection header received
0811 14:26:24.243787 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:24.243788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:24.243803 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:24.243877 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:24.244229 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.244721 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.245445 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.245652 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.245726 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:24.248653 (+ 2927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:45691: BlockingRecv error: recv got EOF from 127.20.132.195:45691 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 14:26:24 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:24 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:25.004099 31354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:24.994408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:47861)
0811 14:26:24.994560 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:24.994571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:24.994624 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:24.994771 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:24.994772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:24.994942 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:24.994991 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:24.994992 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.995648 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.995649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:24.996244 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:24.996247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.996778 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.996780 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:24.996862 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:25.002211 (+ 5349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:25.002216 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:25.004038 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
W20260811 14:26:25.004338 31355 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:24.994509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:47861 (local address 127.20.132.254:36883)
0811 14:26:24.994636 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:24.994638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:24.994646 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:24.994678 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:24.994678 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:24.994689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:24.994751 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:24.995056 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.995578 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.996367 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:24.996688 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:24.996758 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:25.004253 (+ 7495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:47861: BlockingRecv error: recv got EOF from 127.20.132.193:47861 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
Aug 11 14:26:25 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:25 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:25.123338 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:25.117079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:44801)
0811 14:26:25.117249 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:25.117260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:25.117318 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:25.117475 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:25.117476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:25.117674 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:25.117726 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:25.117727 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.118733 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.118734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:25.119386 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:25.119389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.119757 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.119758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:25.119807 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:25.120435 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:25.120441 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:25.123277 (+ 2836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
W20260811 14:26:25.123486 31355 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:25.117183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:44801 (local address 127.20.132.254:36883)
0811 14:26:25.117275 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:25.117279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:25.117302 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:26:25.117379 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:25.117380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:25.117392 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:25.117449 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:25.117875 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.118546 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.119479 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.119671 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.119737 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:25.123401 (+ 3664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:44801: BlockingRecv error: recv got EOF from 127.20.132.194:44801 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 14:26:25 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:25 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:25.253702 31357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:25.249141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:48213)
0811 14:26:25.249297 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:25.249309 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:25.249379 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:25.249516 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:25.249516 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:25.249691 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:25.249744 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:25.249746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.250366 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.250367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:25.250891 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:25.250892 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.251281 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.251282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:25.251329 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:25.251863 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:25.251870 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:25.253644 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
W20260811 14:26:25.253834 31355 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:25.249269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:48213 (local address 127.20.132.254:36883)
0811 14:26:25.249330 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:25.249332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:25.249362 (+ 30us) server_negotiation.cc:407] Connection header received
0811 14:26:25.249432 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:25.249432 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:25.249445 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:25.249495 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:25.249805 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.250297 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.250986 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:25.251197 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:25.251261 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:25.253750 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:48213: BlockingRecv error: recv got EOF from 127.20.132.195:48213 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 14:26:26 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:26 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:26.009794 31359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:26.004677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:51481)
0811 14:26:26.004828 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:26.004839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:26.004897 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:26.005033 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:26.005034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:26.005230 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:26.005277 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:26.005279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.005978 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.005979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:26.006637 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:26.006640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.007167 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.007168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:26.007213 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:26.007746 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:26.007750 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:26.009725 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":107,"threads_started":1}
W20260811 14:26:26.009876 31360 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:26.004766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:51481 (local address 127.20.132.254:36883)
0811 14:26:26.004873 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:26.004875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:26.004885 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:26.004959 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:26.004960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:26.004971 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:26.005030 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:26.005341 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.005916 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.006837 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.007078 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.007158 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:26.009822 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:51481: BlockingRecv error: recv got EOF from 127.20.132.193:51481 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":56,"threads_started":1}
Aug 11 14:26:26 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:26 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:26.128283 31361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:26.123796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:35075)
0811 14:26:26.123935 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:26.123946 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:26.124011 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:26.124154 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:26.124155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:26.124328 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:26.124375 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:26.124377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.125004 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.125005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:26.125545 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:26.125546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.125886 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.125887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:26.125926 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:26.126363 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:26.126367 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:26.128214 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
W20260811 14:26:26.128342 31360 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:26.123866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:35075 (local address 127.20.132.254:36883)
0811 14:26:26.123910 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:26.123912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:26.124013 (+ 101us) server_negotiation.cc:407] Connection header received
0811 14:26:26.124070 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:26.124071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:26.124082 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:26.124129 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:26.124437 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.124933 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.125629 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.125818 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.125873 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:26.128295 (+ 2422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:35075: BlockingRecv error: recv got EOF from 127.20.132.194:35075 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 14:26:26 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:26 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:26.259141 31362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:26.254152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:53031)
0811 14:26:26.254342 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:26.254353 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:26.254424 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:26.254613 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:26.254614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:26.254815 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:26.254861 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:26.254863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.255616 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.255618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:26.256269 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:26.256272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.256639 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.256641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:26.256702 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:26.257181 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:26.257185 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:26.259065 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":100,"threads_started":1}
W20260811 14:26:26.259286 31360 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:26.254250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:53031 (local address 127.20.132.254:36883)
0811 14:26:26.254323 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:26.254326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:26.254404 (+ 78us) server_negotiation.cc:407] Connection header received
0811 14:26:26.254490 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:26.254491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:26.254505 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:26.254605 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:26.254945 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.255523 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.256357 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:26.256550 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:26.256639 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:26.259171 (+ 2532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:53031: BlockingRecv error: recv got EOF from 127.20.132.195:53031 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 14:26:27 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:27 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:27.015460 31363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:27.010490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:37519)
0811 14:26:27.010679 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:27.010695 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:27.010773 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:27.010948 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:27.010949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:27.011132 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:27.011181 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:27.011183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.011882 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.011883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:27.012583 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:27.012585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.012933 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.012934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:27.012982 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:27.013508 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:27.013513 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:27.015333 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":77,"threads_started":1}
W20260811 14:26:27.015552 31364 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:27.010606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:37519 (local address 127.20.132.254:36883)
0811 14:26:27.010749 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:27.010751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:27.010761 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:27.010829 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:27.010829 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:27.010841 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:27.010906 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:27.011266 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.011792 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.012655 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.012853 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.012918 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:27.015464 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:37519: BlockingRecv error: recv got EOF from 127.20.132.193:37519 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
Aug 11 14:26:27 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:27 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:27.133708 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:27.128858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:50911)
0811 14:26:27.129050 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:27.129061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:27.129160 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:27.129318 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:27.129319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:27.129521 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:27.129568 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:27.129570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.130332 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.130333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:27.130916 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:27.130918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.131267 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.131268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:27.131312 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:27.131791 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:27.131795 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:27.133642 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":139,"threads_started":1}
W20260811 14:26:27.133848 31364 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:27.129016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:50911 (local address 127.20.132.254:36883)
0811 14:26:27.129154 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:27.129157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:27.129166 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:27.129235 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:27.129236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:27.129247 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:27.129310 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:27.129665 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.130247 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.130994 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.131194 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.131247 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:27.133736 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:50911: BlockingRecv error: recv got EOF from 127.20.132.194:50911 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 11 14:26:27 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:27 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:27.264557 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:27.259649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:40183)
0811 14:26:27.259804 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:27.259821 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:27.259882 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:27.260029 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:27.260030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:27.260233 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:27.260282 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:27.260284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.260936 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.260937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:27.261479 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:27.261480 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.261893 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.261894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:27.261951 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:27.262429 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:27.262434 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:27.264470 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
W20260811 14:26:27.264672 31364 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:27.259740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:40183 (local address 127.20.132.254:36883)
0811 14:26:27.259820 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:27.259822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:27.259872 (+ 50us) server_negotiation.cc:407] Connection header received
0811 14:26:27.259927 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:27.259928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:27.259942 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:27.260006 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:27.260353 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.260842 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.261596 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:27.261806 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:27.261877 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:27.264608 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:40183: BlockingRecv error: recv got EOF from 127.20.132.195:40183 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 14:26:28 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:28 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:28.020752 31367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:28.015940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:43919)
0811 14:26:28.016120 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:28.016150 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:28.016262 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:28.016414 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:28.016415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:28.016601 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:28.016653 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:28.016655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.017341 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.017342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:28.017887 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:28.017888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.018271 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.018272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:28.018314 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:28.018766 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:28.018778 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:28.020692 (+ 1914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
W20260811 14:26:28.020874 31368 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:28.016035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:43919 (local address 127.20.132.254:36883)
0811 14:26:28.016195 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:28.016197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:28.016241 (+ 44us) server_negotiation.cc:407] Connection header received
0811 14:26:28.016318 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:28.016319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:28.016332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:28.016392 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:28.016746 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.017258 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.017978 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.018199 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.018262 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:28.020790 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:43919: BlockingRecv error: recv got EOF from 127.20.132.193:43919 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
Aug 11 14:26:28 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:28 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:28.139083 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:28.134233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:52919)
0811 14:26:28.134402 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:28.134412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:28.134461 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:28.134608 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:28.134609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:28.134784 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:28.134834 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:28.134836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.135484 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.135485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:28.136023 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:28.136024 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.136534 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.136535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:28.136590 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:28.137073 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:28.137077 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:28.139016 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
W20260811 14:26:28.139233 31368 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:28.134372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:52919 (local address 127.20.132.254:36883)
0811 14:26:28.134450 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:28.134452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:28.134469 (+ 17us) server_negotiation.cc:407] Connection header received
0811 14:26:28.134513 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:28.134513 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:28.134525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:28.134591 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:28.134900 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.135414 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.136217 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.136456 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.136527 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:28.139143 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:52919: BlockingRecv error: recv got EOF from 127.20.132.194:52919 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 14:26:28 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:28 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:28.269675 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:28.265052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:59447)
0811 14:26:28.265209 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:28.265219 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:28.265280 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:28.265410 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:28.265411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:28.265584 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:28.265641 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:28.265643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.266277 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.266278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:28.266833 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:28.266835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.267180 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.267181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:28.267234 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:28.267708 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:28.267712 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:28.269606 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
W20260811 14:26:28.269800 31368 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:28.265127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:59447 (local address 127.20.132.254:36883)
0811 14:26:28.265196 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:28.265198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:28.265266 (+ 68us) server_negotiation.cc:407] Connection header received
0811 14:26:28.265324 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:28.265324 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:28.265338 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:28.265388 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:28.265707 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.266203 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.266908 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:28.267089 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:28.267147 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:28.269702 (+ 2555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:59447: BlockingRecv error: recv got EOF from 127.20.132.195:59447 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 14:26:29 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:29 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:29.026396 31371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:29.021330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:40377)
0811 14:26:29.021500 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:29.021520 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:29.021574 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:29.021805 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:29.021807 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:29.022010 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:29.022062 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:29.022064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.022937 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.022938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:29.023480 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:29.023481 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.023885 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.023886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:29.023957 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:29.024444 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:29.024449 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:29.026338 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":109,"threads_started":1}
W20260811 14:26:29.026568 31372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:29.021469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:40377 (local address 127.20.132.254:36883)
0811 14:26:29.021615 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:29.021617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:29.021626 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:26:29.021660 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:29.021661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:29.021672 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:29.021745 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:29.022198 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.022851 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.023589 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.023805 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.023886 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:29.026471 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:40377: BlockingRecv error: recv got EOF from 127.20.132.193:40377 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
Aug 11 14:26:29 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:29 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:29.144233 31373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:29.139557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:38745)
0811 14:26:29.139713 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:29.139723 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:29.139780 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:29.139926 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:29.139927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:29.140100 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:29.140210 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:29.140212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.140834 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.140834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:29.141433 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:29.141435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.141843 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.141844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:29.141888 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:29.142332 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:29.142336 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:29.144112 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
W20260811 14:26:29.144363 31372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:29.139662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:38745 (local address 127.20.132.254:36883)
0811 14:26:29.139730 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:29.139732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:29.139766 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:26:29.139838 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:29.139839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:29.139850 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:29.139910 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:29.140273 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.140766 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.141493 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.141777 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.141832 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:29.144271 (+ 2439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:38745: BlockingRecv error: recv got EOF from 127.20.132.194:38745 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 14:26:29 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:29 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.195@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:29.275568 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:29.270161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.195:47825)
0811 14:26:29.270343 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:29.270360 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:29.270480 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:29.270690 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:29.270691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:29.270904 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:29.270955 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:29.270957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.271769 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.271770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:29.272394 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:29.272396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.272791 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.272792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:29.272860 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:29.273417 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:29.273430 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:29.275449 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":68,"threads_started":1}
W20260811 14:26:29.275599 31372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:29.270299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47825 (local address 127.20.132.254:36883)
0811 14:26:29.270369 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:29.270371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:29.270457 (+ 86us) server_negotiation.cc:407] Connection header received
0811 14:26:29.270583 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:29.270584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:29.270607 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:29.270683 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:29.271057 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.271665 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.272491 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:29.272704 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:29.272791 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:29.275535 (+ 2744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.195:47825: BlockingRecv error: recv got EOF from 127.20.132.195:47825 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 14:26:30 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:30 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.193@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:30.038008 31375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.026935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.193:47999)
0811 14:26:30.027127 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:30.027138 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:30.027188 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:30.027379 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:30.027380 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:30.027553 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:30.027617 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.027619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.028291 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.028292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.029149 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.029151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.029558 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.029559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.029624 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.035949 (+ 6325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:30.035956 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:30.037935 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":117,"threads_started":1}
W20260811 14:26:30.038187 31376 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:30.027056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:47999 (local address 127.20.132.254:36883)
0811 14:26:30.027162 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.027164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.027188 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:26:30.027259 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.027259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.027270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.027323 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.027704 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.028224 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.029254 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.029491 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.029551 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.038079 (+ 8528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.193:47999: BlockingRecv error: recv got EOF from 127.20.132.193:47999 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":50,"threads_started":1}
Aug 11 14:26:30 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:26:30 dist-test-slave-cbbz krb5kdc[30154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.132.194@KRBTEST.COM for oryx/127.20.132.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:26:30.150261 31377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.144945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:36883 (local address 127.20.132.194:41805)
0811 14:26:30.145119 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:30.145134 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:30.145216 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:30.145392 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:30.145393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:30.145606 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:30.145658 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.145660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.146489 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.146490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.147290 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.147295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.147764 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.147765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.147808 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.148292 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:30.148298 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:30.150188 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.132.254:36883: Server oryx/127.20.132.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":120,"threads_started":1}
W20260811 14:26:30.150331 31376 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:30.145004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:41805 (local address 127.20.132.254:36883)
0811 14:26:30.145066 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.145068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.145210 (+ 142us) server_negotiation.cc:407] Connection header received
0811 14:26:30.145290 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.145291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.145302 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.145345 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.145730 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.146398 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.147423 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.147685 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.147752 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.150282 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.132.194:41805: BlockingRecv error: recv got EOF from 127.20.132.194:41805 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 14:26:30.190196 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 30822
I20260811 14:26:30.199404 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31012
I20260811 14:26:30.204993 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31164
I20260811 14:26:30.210450 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 30740
2026-08-11T14:26:30Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17583 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T14:26:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:30Z Disabled control of system clock
I20260811 14:26:30.240846 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37805
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37805
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 14:26:30.322281 31381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:30.322481 31381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:30.322502 31381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:30.323599 31381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:30.323640 31381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:30.323653 31381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:30.323665 31381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:30.323678 31381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:30.325135 31381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37805
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:30.325320 31381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:30.325552 31381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:30.330569 31391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.330582 31386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.330617 31387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:30.330621 31381 server_base.cc:1034] running on GCE node
I20260811 14:26:30.330987 31381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:30.331308 31381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:30.332453 31381 hybrid_clock.cc:648] HybridClock initialized: now 1786458390332427 us; error 38 us; skew 500 ppm
I20260811 14:26:30.333684 31381 webserver.cc:460] Webserver started at http://127.20.132.254:40437/ using document root <none> and password file <none>
I20260811 14:26:30.333922 31381 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:30.333967 31381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:30.334131 31381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:30.335263 31381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "5f53f62f56f047e9a0ea5aca0383983e"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "46d56695f3877389f87dfc6e074337fd"
server_key_iv: "1f1719261dd18adb5b8d7c0f61667434"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.335623 31381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "5f53f62f56f047e9a0ea5aca0383983e"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "46d56695f3877389f87dfc6e074337fd"
server_key_iv: "1f1719261dd18adb5b8d7c0f61667434"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.336992 31381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:30.337738 31398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.337913 31381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:30.337998 31381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "5f53f62f56f047e9a0ea5aca0383983e"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "46d56695f3877389f87dfc6e074337fd"
server_key_iv: "1f1719261dd18adb5b8d7c0f61667434"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.338053 31381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:30.348974 31381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:30.349228 31381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:30.349332 31381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:30.353436 31381 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37805
I20260811 14:26:30.353466 31456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37805 every 8 connection(s)
I20260811 14:26:30.353816 31381 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:30.354470 31457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:30.354976 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31381
I20260811 14:26:30.355093 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:30.355312 21011 external_mini_cluster.cc:1428] Setting key 6cff4cbfd9ad59a3d257d6442d691dd7
I20260811 14:26:30.357956 31457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e: Bootstrap starting.
I20260811 14:26:30.358542 31457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:30.358882 31457 log.cc:824] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:30.359642 31457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e: No bootstrap required, opened a new log
I20260811 14:26:30.361022 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.355880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35756 (local address 127.20.132.254:37805)
0811 14:26:30.356099 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.356106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.356131 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:26:30.356613 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.356619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.356681 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.356824 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.357072 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.357907 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.358752 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.359329 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.359464 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.360281 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:30.360285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:30.360286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:30.360493 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:30.360533 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:30.360547 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:30.360630 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:30.360738 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 14:26:30.360819 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260811 14:26:30.361570 31457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f53f62f56f047e9a0ea5aca0383983e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37805 } }
I20260811 14:26:30.361758 31457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:30.361810 31457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f53f62f56f047e9a0ea5aca0383983e, State: Initialized, Role: FOLLOWER
I20260811 14:26:30.361932 31457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f53f62f56f047e9a0ea5aca0383983e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37805 } }
I20260811 14:26:30.362020 31457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:30.362054 31457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:30.362093 31457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:30.362573 31457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f53f62f56f047e9a0ea5aca0383983e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37805 } }
I20260811 14:26:30.362659 31457 leader_election.cc:302] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f53f62f56f047e9a0ea5aca0383983e; no voters:
I20260811 14:26:30.362779 31457 leader_election.cc:288] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:30.362859 31462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:30.363023 31457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:30.363059 31462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [term 1 LEADER]: Becoming Leader. State: Replica: 5f53f62f56f047e9a0ea5aca0383983e, State: Running, Role: LEADER
I20260811 14:26:30.363137 31462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f53f62f56f047e9a0ea5aca0383983e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37805 } }
I20260811 14:26:30.363560 31463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f53f62f56f047e9a0ea5aca0383983e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f53f62f56f047e9a0ea5aca0383983e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37805 } } }
I20260811 14:26:30.363664 31463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:30.363838 31464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f53f62f56f047e9a0ea5aca0383983e. Latest consensus state: current_term: 1 leader_uuid: "5f53f62f56f047e9a0ea5aca0383983e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f53f62f56f047e9a0ea5aca0383983e" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37805 } } }
I20260811 14:26:30.363862 31471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:30.363900 31464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:30.364365 31471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:30.365831 31471 catalog_manager.cc:1347] Generated new cluster ID: 66a604864f4c41d8b02d1bff2b5eeb41
I20260811 14:26:30.365888 31471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:30.374183 31471 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:30.374827 31471 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:30.381326 31471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f53f62f56f047e9a0ea5aca0383983e: Generated new TSK 0
I20260811 14:26:30.381482 31471 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:26:30.390781 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37805
--builtin_ntp_servers=127.20.132.212:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 14:26:30.472486 31482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:30.472720 31482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:30.472754 31482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:30.474001 31482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:30.474057 31482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:30.474098 31482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:30.475425 31482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:30.475690 31482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:30.475981 31482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:30.481947 31492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.481983 31490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.482263 31489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:30.482306 31482 server_base.cc:1034] running on GCE node
I20260811 14:26:30.482522 31482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:30.482766 31482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:30.483932 31482 hybrid_clock.cc:648] HybridClock initialized: now 1786458390483916 us; error 43 us; skew 500 ppm
I20260811 14:26:30.485241 31482 webserver.cc:460] Webserver started at http://127.20.132.193:33593/ using document root <none> and password file <none>
I20260811 14:26:30.485478 31482 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:30.485548 31482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:30.485693 31482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:30.486742 31482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "551d74ad00d94a2bbc1ef6e23704ab30"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "a0e4d759471c185a650775395e2af6cb"
server_key_iv: "f805f5f6c900c30c36b8b933f67e285e"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.487115 31482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "551d74ad00d94a2bbc1ef6e23704ab30"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "a0e4d759471c185a650775395e2af6cb"
server_key_iv: "f805f5f6c900c30c36b8b933f67e285e"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.488444 31482 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:30.489187 31499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.489385 31482 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:30.489483 31482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "551d74ad00d94a2bbc1ef6e23704ab30"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "a0e4d759471c185a650775395e2af6cb"
server_key_iv: "f805f5f6c900c30c36b8b933f67e285e"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.489568 31482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:30.525385 31482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:30.525750 31482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:30.525911 31482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:30.526165 31482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:30.526536 31482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:30.526592 31482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.526628 31482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:30.526669 31482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.532635 31482 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:35467
I20260811 14:26:30.532733 31626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:35467 every 8 connection(s)
I20260811 14:26:30.533061 31482 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:30.536680 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31482
I20260811 14:26:30.536777 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:30.536962 21011 external_mini_cluster.cc:1428] Setting key 8acefd736d3632704f2d5f137400dce1
I20260811 14:26:30.538143 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37805
--builtin_ntp_servers=127.20.132.212:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 14:26:30.538861 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.533997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:39593 (local address 127.20.132.254:37805)
0811 14:26:30.534055 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.534057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.534156 (+ 99us) server_negotiation.cc:407] Connection header received
0811 14:26:30.534653 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.534654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.534669 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.534719 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.535357 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.535879 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.537207 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.537493 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.537571 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.538585 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:30.538587 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:30.538587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:30.538591 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:30.538605 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:30.538609 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:30.538654 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:30.538771 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 14:26:30.538802 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:26:30.539131 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.533808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37805 (local address 127.20.132.193:39593)
0811 14:26:30.534023 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:30.534072 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:30.534570 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:30.534787 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:30.534790 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:30.534799 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:30.535278 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.535283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.535962 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.535963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.537099 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.537104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.537595 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.537596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.537775 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.538431 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:26:30.538432 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:30.538469 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:26:30.538496 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:30.538677 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:30.538683 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:30.538687 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:30.538759 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 14:26:30.538873 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
I20260811 14:26:30.540266 31627 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37805
I20260811 14:26:30.540371 31627 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:30.540555 31627 heartbeater.cc:511] Master 127.20.132.254:37805 requested a full tablet report, sending...
I20260811 14:26:30.541213 31416 ts_manager.cc:194] Registered new tserver with Master: 551d74ad00d94a2bbc1ef6e23704ab30 (127.20.132.193:35467)
I20260811 14:26:30.542194 31416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.193:39593
W20260811 14:26:30.622169 31630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:30.622364 31630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:30.622385 31630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:30.623443 31630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:30.623474 31630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:30.623497 31630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:30.624809 31630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:30.625000 31630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:30.625242 31630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:30.630153 31639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.630157 31641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.630208 31637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:30.630527 31630 server_base.cc:1034] running on GCE node
I20260811 14:26:30.630757 31630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:30.631023 31630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:30.632220 31630 hybrid_clock.cc:648] HybridClock initialized: now 1786458390632202 us; error 25 us; skew 500 ppm
I20260811 14:26:30.633507 31630 webserver.cc:460] Webserver started at http://127.20.132.194:39147/ using document root <none> and password file <none>
I20260811 14:26:30.633812 31630 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:30.633894 31630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:30.634035 31630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:30.635097 31630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "0e8777182db5428daa3860923e51c3bc"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "1601c97014c7a1f7ad2245eb79de8740"
server_key_iv: "ba405f32e5e3ef4e86095327f44b9830"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.635459 31630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "0e8777182db5428daa3860923e51c3bc"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "1601c97014c7a1f7ad2245eb79de8740"
server_key_iv: "ba405f32e5e3ef4e86095327f44b9830"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.636831 31630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:30.637631 31647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.637815 31630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:30.637912 31630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "0e8777182db5428daa3860923e51c3bc"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "1601c97014c7a1f7ad2245eb79de8740"
server_key_iv: "ba405f32e5e3ef4e86095327f44b9830"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.637997 31630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:30.683816 31630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:30.684199 31630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:30.684362 31630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:30.684640 31630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:30.685014 31630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:30.685067 31630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.685102 31630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:30.685130 31630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.691030 31630 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:33423
I20260811 14:26:30.691085 31771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:33423 every 8 connection(s)
I20260811 14:26:30.691411 31630 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:30.695314 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31630
I20260811 14:26:30.695415 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:30.695600 21011 external_mini_cluster.cc:1428] Setting key 3c2be35a3eed8bdd87086fc153f4ad6a
I20260811 14:26:30.696612 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37805
--builtin_ntp_servers=127.20.132.212:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 14:26:30.697007 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.692272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:49387 (local address 127.20.132.254:37805)
0811 14:26:30.692336 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.692338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.692560 (+ 222us) server_negotiation.cc:407] Connection header received
0811 14:26:30.693097 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.693098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.693109 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.693177 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.693849 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.694352 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.695302 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.695624 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.695707 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.696731 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:30.696732 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:30.696732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:30.696737 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:30.696750 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:30.696755 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:30.696796 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:30.696906 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 14:26:30.696931 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:26:30.697247 31774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.692221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37805 (local address 127.20.132.194:49387)
0811 14:26:30.692422 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:30.692464 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:30.692975 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:30.693264 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:30.693267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:30.693275 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:30.693772 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.693777 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.694432 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.694433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.695208 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.695210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.695738 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.695739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.695898 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.696574 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:26:30.696574 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:30.696604 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:26:30.696625 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:30.696809 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:30.696813 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:30.696816 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:30.696909 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 14:26:30.697006 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260811 14:26:30.697682 31772 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37805
I20260811 14:26:30.697770 31772 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:30.697965 31772 heartbeater.cc:511] Master 127.20.132.254:37805 requested a full tablet report, sending...
I20260811 14:26:30.698323 31416 ts_manager.cc:194] Registered new tserver with Master: 0e8777182db5428daa3860923e51c3bc (127.20.132.194:33423)
I20260811 14:26:30.698695 31416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.194:49387
W20260811 14:26:30.779122 31777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:30.779320 31777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:30.779341 31777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:30.780534 31777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:30.780573 31777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:30.780602 31777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:30.781951 31777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:30.782227 31777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:30.782539 31777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:30.787374 31783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.787393 31784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.787453 31786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:30.787643 31777 server_base.cc:1034] running on GCE node
I20260811 14:26:30.787866 31777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:30.788092 31777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:30.789274 31777 hybrid_clock.cc:648] HybridClock initialized: now 1786458390789260 us; error 32 us; skew 500 ppm
I20260811 14:26:30.790503 31777 webserver.cc:460] Webserver started at http://127.20.132.195:40903/ using document root <none> and password file <none>
I20260811 14:26:30.790766 31777 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:30.790834 31777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:30.790973 31777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:30.792109 31777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "4fdf0816331842e88b17777bc94ff375"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "c5c94c8085461064796d40ad58c76bab"
server_key_iv: "e8c64c1e7529ba03f2bb572105119adc"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.792557 31777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "4fdf0816331842e88b17777bc94ff375"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "c5c94c8085461064796d40ad58c76bab"
server_key_iv: "e8c64c1e7529ba03f2bb572105119adc"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.793926 31777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:30.794625 31792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.794793 31777 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.794885 31777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "4fdf0816331842e88b17777bc94ff375"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "c5c94c8085461064796d40ad58c76bab"
server_key_iv: "e8c64c1e7529ba03f2bb572105119adc"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.794960 31777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:30.803013 31777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:30.803268 31777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:30.803411 31777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:30.803618 31777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:30.803920 31777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:30.803973 31777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.804011 31777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:30.804037 31777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.810570 31777 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:37181
I20260811 14:26:30.810603 31916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:37181 every 8 connection(s)
I20260811 14:26:30.810942 31777 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:30.812057 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31777
I20260811 14:26:30.812194 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:30.812400 21011 external_mini_cluster.cc:1428] Setting key efe366aaaf6c3a4e53476a8772ed4181
I20260811 14:26:30.816421 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.811739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:51539 (local address 127.20.132.254:37805)
0811 14:26:30.811823 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.811826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.812165 (+ 339us) server_negotiation.cc:407] Connection header received
0811 14:26:30.812815 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.812817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.812830 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.812881 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.813524 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.814026 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.814989 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.815201 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.815280 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.816074 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:30.816075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:30.816075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:30.816100 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:30.816117 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:30.816124 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:30.816217 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:30.816313 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 14:26:30.816341 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:26:30.816646 31920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.811718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37805 (local address 127.20.132.195:51539)
0811 14:26:30.811977 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:30.812024 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:30.812695 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:30.812951 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:30.812954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:30.812962 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:30.813434 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.813437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.814132 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.814134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.814896 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:30.814898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:30.815289 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:30.815291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:30.815416 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:30.815920 (+ 504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:26:30.815921 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:30.815948 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:26:30.815969 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:30.816218 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:30.816225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:30.816229 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:30.816316 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 14:26:30.816414 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":97,"threads_started":1}
I20260811 14:26:30.817135 31918 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37805
I20260811 14:26:30.817214 31918 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:30.817406 31918 heartbeater.cc:511] Master 127.20.132.254:37805 requested a full tablet report, sending...
I20260811 14:26:30.817776 31416 ts_manager.cc:194] Registered new tserver with Master: 4fdf0816331842e88b17777bc94ff375 (127.20.132.195:37181)
I20260811 14:26:30.818195 31416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.195:51539
I20260811 14:26:30.824292 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 14:26:30.826282 31460 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:30.825757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35766 (local address 127.20.132.254:37805)
0811 14:26:30.825811 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.825813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.825939 (+ 126us) server_negotiation.cc:407] Connection header received
0811 14:26:30.825992 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.825993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.826001 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.826059 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.826189 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35766: BlockingRecv error: recv got EOF from 127.0.0.1:35766 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:26:30.826377 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31482
I20260811 14:26:30.836408 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31630
I20260811 14:26:30.842568 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31777
I20260811 14:26:30.848789 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31381
2026-08-11T14:26:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (636 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T14:26:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:30Z Disabled control of system clock
I20260811 14:26:30.877662 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:35277
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:35277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 14:26:30.958295 31930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:30.958498 31930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:30.958519 31930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:30.959576 31930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:30.959611 31930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:30.959623 31930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:30.959636 31930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:30.959648 31930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:30.960920 31930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:35277
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:35277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:30.961117 31930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:30.961416 31930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:30.966215 31935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.966204 31936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:30.966209 31938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:30.966595 31930 server_base.cc:1034] running on GCE node
I20260811 14:26:30.966822 31930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:30.967144 31930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:30.968286 31930 hybrid_clock.cc:648] HybridClock initialized: now 1786458390968262 us; error 41 us; skew 500 ppm
I20260811 14:26:30.969537 31930 webserver.cc:460] Webserver started at http://127.20.132.254:41157/ using document root <none> and password file <none>
I20260811 14:26:30.969781 31930 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:30.969851 31930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:30.970005 31930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:30.971057 31930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "8d00463440644d99ae8dbf02ad77ac49"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "d29bc4c4dd1450869c022a03ce3b2451"
server_key_iv: "e8b29a6044462b74162d4e13da655eb9"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.971422 31930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "8d00463440644d99ae8dbf02ad77ac49"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "d29bc4c4dd1450869c022a03ce3b2451"
server_key_iv: "e8b29a6044462b74162d4e13da655eb9"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.972854 31930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:30.973881 31945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:30.974143 31930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:30.974254 31930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8d00463440644d99ae8dbf02ad77ac49"
format_stamp: "Formatted at 2026-08-11 14:26:30 on dist-test-slave-cbbz"
server_key: "d29bc4c4dd1450869c022a03ce3b2451"
server_key_iv: "e8b29a6044462b74162d4e13da655eb9"
server_key_version: "encryptionkey@0"
I20260811 14:26:30.974334 31930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:30.979676 31930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:30.979979 31930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:30.980123 31930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:30.985303 31930 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:35277
I20260811 14:26:30.985384 32004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:35277 every 8 connection(s)
I20260811 14:26:30.985754 31930 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:30.986533 32005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:30.990639 32005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49: Bootstrap starting.
I20260811 14:26:30.991417 32005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:30.991782 32005 log.cc:824] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:30.991956 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 31930
I20260811 14:26:30.992046 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:30.992285 21011 external_mini_cluster.cc:1428] Setting key f8b1eeeef73e7aacb6280029e4110e7b
I20260811 14:26:30.992887 32005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49: No bootstrap required, opened a new log
I20260811 14:26:30.995664 32005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d00463440644d99ae8dbf02ad77ac49" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35277 } }
I20260811 14:26:30.995854 32005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:30.995949 32005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d00463440644d99ae8dbf02ad77ac49, State: Initialized, Role: FOLLOWER
I20260811 14:26:30.996011 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:30.992839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40488 (local address 127.20.132.254:35277)
0811 14:26:30.993078 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:30.993087 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:30.993133 (+ 46us) server_negotiation.cc:407] Connection header received
0811 14:26:30.994489 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:30.994496 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:30.994540 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:30.994696 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:30.995448 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:30.995453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:30.995453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:30.995457 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:30.995507 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:30.995521 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:30.995610 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:30.995716 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 14:26:30.995773 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260811 14:26:30.996115 32005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d00463440644d99ae8dbf02ad77ac49" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35277 } }
I20260811 14:26:30.996222 32005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:30.996259 32005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:30.996302 32005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:30.997532 32005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d00463440644d99ae8dbf02ad77ac49" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35277 } }
I20260811 14:26:30.997642 32005 leader_election.cc:302] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d00463440644d99ae8dbf02ad77ac49; no voters:
I20260811 14:26:30.997807 32005 leader_election.cc:288] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:30.997923 32010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:30.998102 32005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:30.998163 32010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [term 1 LEADER]: Becoming Leader. State: Replica: 8d00463440644d99ae8dbf02ad77ac49, State: Running, Role: LEADER
I20260811 14:26:30.998273 32010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d00463440644d99ae8dbf02ad77ac49" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35277 } }
I20260811 14:26:30.998688 32011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d00463440644d99ae8dbf02ad77ac49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d00463440644d99ae8dbf02ad77ac49" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35277 } } }
I20260811 14:26:30.998816 32011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:30.999068 32019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:30.998674 32012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d00463440644d99ae8dbf02ad77ac49. Latest consensus state: current_term: 1 leader_uuid: "8d00463440644d99ae8dbf02ad77ac49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d00463440644d99ae8dbf02ad77ac49" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35277 } } }
I20260811 14:26:30.999243 32012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49 [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:30.999724 32019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:31.001330 32019 catalog_manager.cc:1347] Generated new cluster ID: e3fc753f195044dd8d6d89577cb08344
I20260811 14:26:31.001427 32019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:26:31.017563 32019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:31.017728 32019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:31.025820 32019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d00463440644d99ae8dbf02ad77ac49: Generated new TSK 0
I20260811 14:26:31.025998 32019 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:26:31.035094 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35277
--builtin_ntp_servers=127.20.132.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 14:26:31.118017 32030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:31.118297 32030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:31.118340 32030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:31.119555 32030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:31.119594 32030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:31.119627 32030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:31.121030 32030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:31.121279 32030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:31.121579 32030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:31.127269 32035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:31.127351 32036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:31.127493 32038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:31.127720 32030 server_base.cc:1034] running on GCE node
I20260811 14:26:31.127903 32030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:31.128106 32030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:31.129288 32030 hybrid_clock.cc:648] HybridClock initialized: now 1786458391129276 us; error 30 us; skew 500 ppm
I20260811 14:26:31.130573 32030 webserver.cc:460] Webserver started at http://127.20.132.193:44571/ using document root <none> and password file <none>
I20260811 14:26:31.130834 32030 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:31.130903 32030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:31.131064 32030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:31.132181 32030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "2cc2fa761d994617b32bdaa632f4b3d5"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "49dbb79381575f7809268ff3bf217df9"
server_key_iv: "b844d369cc3c8430fb175ba318613d1d"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.132573 32030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "2cc2fa761d994617b32bdaa632f4b3d5"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "49dbb79381575f7809268ff3bf217df9"
server_key_iv: "b844d369cc3c8430fb175ba318613d1d"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.133867 32030 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:31.134611 32044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.134800 32030 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.134895 32030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "2cc2fa761d994617b32bdaa632f4b3d5"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "49dbb79381575f7809268ff3bf217df9"
server_key_iv: "b844d369cc3c8430fb175ba318613d1d"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.134979 32030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:31.138288 32030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:31.138595 32030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:31.138738 32030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:31.138969 32030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:31.139276 32030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:31.139335 32030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.139375 32030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:31.139405 32030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.145318 32030 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:37403
I20260811 14:26:31.145370 32165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:37403 every 8 connection(s)
I20260811 14:26:31.145668 32030 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:31.148593 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:31.146300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:46201 (local address 127.20.132.254:35277)
0811 14:26:31.146344 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:31.146346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:31.146588 (+ 242us) server_negotiation.cc:407] Connection header received
0811 14:26:31.147112 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:31.147113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:31.147120 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:31.147169 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:31.148351 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:31.148352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:31.148353 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:31.148358 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:31.148374 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:31.148378 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:31.148427 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:31.148508 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 14:26:31.148523 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:26:31.148794 32168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:31.146283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35277 (local address 127.20.132.193:46201)
0811 14:26:31.146469 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:31.146502 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:31.147003 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:31.147234 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:31.147238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:31.147247 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:31.148199 (+ 952us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:26:31.148200 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:31.148235 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:26:31.148261 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:31.148435 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:31.148440 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:31.148443 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:31.148517 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:26:31.148577 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260811 14:26:31.149315 32166 heartbeater.cc:347] Connected to a master server at 127.20.132.254:35277
I20260811 14:26:31.149425 32166 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:31.149571 32166 heartbeater.cc:511] Master 127.20.132.254:35277 requested a full tablet report, sending...
I20260811 14:26:31.150079 31964 ts_manager.cc:194] Registered new tserver with Master: 2cc2fa761d994617b32bdaa632f4b3d5 (127.20.132.193:37403)
I20260811 14:26:31.150543 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 32030
I20260811 14:26:31.150653 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:31.150851 21011 external_mini_cluster.cc:1428] Setting key 63f19db9ab7d7552230ca5d9950b57d3
I20260811 14:26:31.151664 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35277
--builtin_ntp_servers=127.20.132.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 14:26:31.232599 32169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:31.232838 32169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:31.232875 32169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:31.234007 32169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:31.234072 32169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:31.234124 32169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:31.235468 32169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:31.235740 32169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:31.236045 32169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:31.240945 32177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:31.240939 32175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:31.240939 32174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:31.241209 32169 server_base.cc:1034] running on GCE node
I20260811 14:26:31.241426 32169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:31.241693 32169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:31.242848 32169 hybrid_clock.cc:648] HybridClock initialized: now 1786458391242853 us; error 45 us; skew 500 ppm
I20260811 14:26:31.244009 32169 webserver.cc:460] Webserver started at http://127.20.132.194:40827/ using document root <none> and password file <none>
I20260811 14:26:31.244318 32169 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:31.244393 32169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:31.244539 32169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:31.245561 32169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "ffb3750484bc4c10bba4d311bcccefdb"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "c113e972f3ab85b21076e1d0c3967773"
server_key_iv: "8602fd0f3eaa90aa026c833dcdd9c673"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.245930 32169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "ffb3750484bc4c10bba4d311bcccefdb"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "c113e972f3ab85b21076e1d0c3967773"
server_key_iv: "8602fd0f3eaa90aa026c833dcdd9c673"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.247233 32169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:31.247921 32183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.248090 32169 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:31.248216 32169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "ffb3750484bc4c10bba4d311bcccefdb"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "c113e972f3ab85b21076e1d0c3967773"
server_key_iv: "8602fd0f3eaa90aa026c833dcdd9c673"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.248306 32169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:31.251565 32169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:31.251832 32169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:31.251979 32169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:31.252244 32169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:31.252552 32169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:31.252606 32169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.252640 32169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:31.252665 32169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.258729 32169 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:39937
I20260811 14:26:31.258775 32305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:39937 every 8 connection(s)
I20260811 14:26:31.259087 32169 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:26:31.262094 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:31.259793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:37363 (local address 127.20.132.254:35277)
0811 14:26:31.259860 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:31.259863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:31.260103 (+ 240us) server_negotiation.cc:407] Connection header received
0811 14:26:31.260640 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:31.260641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:31.260647 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:31.260700 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:31.261912 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:31.261913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:31.261913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:31.261915 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:31.261926 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:31.261929 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:31.261970 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:31.262027 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 14:26:31.262039 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:26:31.262308 32308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:31.259781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35277 (local address 127.20.132.194:37363)
0811 14:26:31.259979 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:31.260012 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:31.260536 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:31.260750 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:31.260753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:31.260760 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:31.261780 (+ 1020us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:26:31.261781 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:31.261809 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:26:31.261836 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:31.261970 (+ 134us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:31.261972 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:31.261974 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:26:31.262025 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 14:26:31.262070 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260811 14:26:31.262804 32306 heartbeater.cc:347] Connected to a master server at 127.20.132.254:35277
I20260811 14:26:31.262914 32306 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:31.263079 32306 heartbeater.cc:511] Master 127.20.132.254:35277 requested a full tablet report, sending...
I20260811 14:26:31.263448 31964 ts_manager.cc:194] Registered new tserver with Master: ffb3750484bc4c10bba4d311bcccefdb (127.20.132.194:39937)
I20260811 14:26:31.266712 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 32169
I20260811 14:26:31.266829 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:31.267023 21011 external_mini_cluster.cc:1428] Setting key eb39c358d981af983a5ccbfae9bc5d59
I20260811 14:26:31.267943 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35277
--builtin_ntp_servers=127.20.132.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 14:26:31.350831 32309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:31.351038 32309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:31.351059 32309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:31.352246 32309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:31.352284 32309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:31.352310 32309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:31.353572 32309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:31.353756 32309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:31.353971 32309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:31.358875 32314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:31.358886 32315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:31.358886 32317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:31.359169 32309 server_base.cc:1034] running on GCE node
I20260811 14:26:31.359495 32309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:31.359741 32309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:31.360881 32309 hybrid_clock.cc:648] HybridClock initialized: now 1786458391360872 us; error 32 us; skew 500 ppm
I20260811 14:26:31.362123 32309 webserver.cc:460] Webserver started at http://127.20.132.195:43187/ using document root <none> and password file <none>
I20260811 14:26:31.362362 32309 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:31.362432 32309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:31.362584 32309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:31.363662 32309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "cabcd479804b4c829bd3c54477af7d38"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "b5c819702c5eef21aea9ed135dc7ccc3"
server_key_iv: "a8b7d33afc22a17cda675d25471c78e9"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.364029 32309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "cabcd479804b4c829bd3c54477af7d38"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "b5c819702c5eef21aea9ed135dc7ccc3"
server_key_iv: "a8b7d33afc22a17cda675d25471c78e9"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.365334 32309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:26:31.366044 32323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.366228 32309 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:31.366326 32309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "cabcd479804b4c829bd3c54477af7d38"
format_stamp: "Formatted at 2026-08-11 14:26:31 on dist-test-slave-cbbz"
server_key: "b5c819702c5eef21aea9ed135dc7ccc3"
server_key_iv: "a8b7d33afc22a17cda675d25471c78e9"
server_key_version: "encryptionkey@0"
I20260811 14:26:31.366408 32309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:31.369781 32309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:31.370054 32309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:31.370193 32309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:31.370401 32309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:31.370715 32309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:31.370769 32309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.370807 32309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:31.370834 32309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:31.377007 32309 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:38135
I20260811 14:26:31.377045 32446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:38135 every 8 connection(s)
I20260811 14:26:31.377388 32309 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:31.380549 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:31.378090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:46065 (local address 127.20.132.254:35277)
0811 14:26:31.378135 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:31.378137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:31.378421 (+ 284us) server_negotiation.cc:407] Connection header received
0811 14:26:31.378949 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:31.378950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:31.378958 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:31.379030 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:31.380292 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:31.380293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:31.380293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:26:31.380299 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:31.380317 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:26:31.380322 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:31.380386 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:31.380467 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 14:26:31.380481 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:26:31.380683 32450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:31.378084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35277 (local address 127.20.132.195:46065)
0811 14:26:31.378298 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:31.378330 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:31.378808 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:31.379105 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:31.379109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:31.379120 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:31.380057 (+ 937us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:26:31.380058 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:31.380102 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:26:31.380165 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:31.380392 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:31.380397 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:31.380400 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:31.380458 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 14:26:31.380505 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260811 14:26:31.381228 32447 heartbeater.cc:347] Connected to a master server at 127.20.132.254:35277
I20260811 14:26:31.381337 32447 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:31.381498 32447 heartbeater.cc:511] Master 127.20.132.254:35277 requested a full tablet report, sending...
I20260811 14:26:31.381860 31964 ts_manager.cc:194] Registered new tserver with Master: cabcd479804b4c829bd3c54477af7d38 (127.20.132.195:38135)
I20260811 14:26:31.382966 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 32309
I20260811 14:26:31.383031 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:31.383172 21011 external_mini_cluster.cc:1428] Setting key 9fe2335a0674c50b8483c73977ede6e9
I20260811 14:26:31.383991 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 14:26:31.386385 32009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:26:31.385899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40496 (local address 127.20.132.254:35277)
0811 14:26:31.385933 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:31.385935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:31.386123 (+ 188us) server_negotiation.cc:407] Connection header received
0811 14:26:31.386179 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:31.386179 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:31.386183 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:31.386231 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:31.386345 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40496: BlockingRecv error: recv got EOF from 127.0.0.1:40496 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:26:31.386639 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 32030
I20260811 14:26:31.398332 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 32169
I20260811 14:26:31.405396 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 32309
I20260811 14:26:31.412457 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 31930
2026-08-11T14:26:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (565 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:31 dist-test-slave-cbbz krb5kdc[32459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:31 dist-test-slave-cbbz krb5kdc[32459](info): set up 2 sockets
Aug 11 14:26:31 dist-test-slave-cbbz krb5kdc[32459](info): commencing operation
krb5kdc: starting...
W20260811 14:26:32.520046 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:32 dist-test-slave-cbbz krb5kdc[32459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:26:32.645738 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37169
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:32.728294 32473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:32.728538 32473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:32.728574 32473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:32.729699 32473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:26:32.729768 32473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:32.729795 32473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:32.729827 32473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:26:32.729849 32473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:26:32.731287 32473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:32.731546 32473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:32.731775 32473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:32.736500 32480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:32.736490 32484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:32.736490 32479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:32.736876 32473 server_base.cc:1034] running on GCE node
I20260811 14:26:32.737136 32473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:32.737460 32473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:32.738621 32473 hybrid_clock.cc:648] HybridClock initialized: now 1786458392738599 us; error 55 us; skew 500 ppm
Aug 11 14:26:32 dist-test-slave-cbbz krb5kdc[32459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458392, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:32.741482 32473 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:26:32.741937 32473 webserver.cc:460] Webserver started at http://127.20.132.254:38065/ using document root <none> and password file <none>
I20260811 14:26:32.742175 32473 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:32.742250 32473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:32.742419 32473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:32.743492 32473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "ff24db3b934644f2877e3f14c43b48ce"
format_stamp: "Formatted at 2026-08-11 14:26:32 on dist-test-slave-cbbz"
server_key: "7c999fb42c48035a8cc2540f016fe993"
server_key_iv: "9e42856471c23d026793f23d1e821a51"
server_key_version: "encryptionkey@0"
I20260811 14:26:32.743889 32473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "ff24db3b934644f2877e3f14c43b48ce"
format_stamp: "Formatted at 2026-08-11 14:26:32 on dist-test-slave-cbbz"
server_key: "7c999fb42c48035a8cc2540f016fe993"
server_key_iv: "9e42856471c23d026793f23d1e821a51"
server_key_version: "encryptionkey@0"
I20260811 14:26:32.745366 32473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:32.746084 32491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:32.746289 32473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:26:32.746395 32473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "ff24db3b934644f2877e3f14c43b48ce"
format_stamp: "Formatted at 2026-08-11 14:26:32 on dist-test-slave-cbbz"
server_key: "7c999fb42c48035a8cc2540f016fe993"
server_key_iv: "9e42856471c23d026793f23d1e821a51"
server_key_version: "encryptionkey@0"
I20260811 14:26:32.746483 32473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:32.757022 32473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:32.759505 32473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:32.759693 32473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:32.764225 32473 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37169
I20260811 14:26:32.764235 32546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37169 every 8 connection(s)
I20260811 14:26:32.764652 32473 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:26:32.765641 32547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:32.767812 32547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce: Bootstrap starting.
I20260811 14:26:32.768440 32547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:32.768694 32547 log.cc:824] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:32.769413 32547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce: No bootstrap required, opened a new log
I20260811 14:26:32.770947 32547 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff24db3b934644f2877e3f14c43b48ce" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37169 } }
I20260811 14:26:32.771080 32547 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:32.771109 32547 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff24db3b934644f2877e3f14c43b48ce, State: Initialized, Role: FOLLOWER
I20260811 14:26:32.771242 32547 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff24db3b934644f2877e3f14c43b48ce" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37169 } }
I20260811 14:26:32.771324 32547 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:26:32.771347 32547 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:26:32.771376 32547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:32.771879 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 32473
I20260811 14:26:32.771994 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:26:32.772253 21011 external_mini_cluster.cc:1428] Setting key 56b3b59e06622970a6e87e252b45c3b9
I20260811 14:26:32.772277 32547 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff24db3b934644f2877e3f14c43b48ce" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37169 } }
I20260811 14:26:32.772392 32547 leader_election.cc:302] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff24db3b934644f2877e3f14c43b48ce; no voters:
I20260811 14:26:32.772562 32547 leader_election.cc:288] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:26:32.772629 32550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:32.772782 32550 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [term 1 LEADER]: Becoming Leader. State: Replica: ff24db3b934644f2877e3f14c43b48ce, State: Running, Role: LEADER
I20260811 14:26:32.772840 32547 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:26:32.772879 32550 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff24db3b934644f2877e3f14c43b48ce" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37169 } }
I20260811 14:26:32.773183 32550 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff24db3b934644f2877e3f14c43b48ce. Latest consensus state: current_term: 1 leader_uuid: "ff24db3b934644f2877e3f14c43b48ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff24db3b934644f2877e3f14c43b48ce" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37169 } } }
I20260811 14:26:32.773286 32550 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:32.773195 32552 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff24db3b934644f2877e3f14c43b48ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff24db3b934644f2877e3f14c43b48ce" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37169 } } }
I20260811 14:26:32.773437 32552 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce [sys.catalog]: This master's current role is: LEADER
I20260811 14:26:32.773528 32559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:26:32.774104 32559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:26:32.777242 32559 catalog_manager.cc:1347] Generated new cluster ID: d87df22447ee4258a050f538db5e33c9
I20260811 14:26:32.777307 32559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:26:32 dist-test-slave-cbbz krb5kdc[32459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:32.785581 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:32.772928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.20.132.254:37169)
0811 14:26:32.773136 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:32.773145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:32.773406 (+ 261us) server_negotiation.cc:407] Connection header received
0811 14:26:32.773539 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:32.773548 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:32.773611 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:32.773761 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:32.774912 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:32.776331 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:32.777298 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:32.777922 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:32.778037 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:32.780993 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:32.780997 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:32.780998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:32.781010 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:32.783696 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:32.784112 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:32.784115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:32.784115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:32.784254 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:32.784496 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:32.784498 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:32.784498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:32.784815 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:32.784942 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:32.785213 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 14:26:32.785354 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":64,"threads_started":1}
I20260811 14:26:32.796914 32559 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:26:32.797472 32559 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:26:32.801366 32559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce: Generated new TSK 0
I20260811 14:26:32.801543 32559 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:26:32.835399 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37169
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:32.919879 32575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:32.920085 32575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:32.920110 32575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:32.921270 32575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:32.921312 32575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:32.921339 32575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:26:32.922778 32575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:32.923012 32575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:32.923262 32575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:32.928474 32583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:32.928486 32581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:32.928648 32575 server_base.cc:1034] running on GCE node
W20260811 14:26:32.928680 32580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:32.928865 32575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:32.929105 32575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:32.930282 32575 hybrid_clock.cc:648] HybridClock initialized: now 1786458392930273 us; error 31 us; skew 500 ppm
Aug 11 14:26:32 dist-test-slave-cbbz krb5kdc[32459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458392, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:32.932866 32575 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:26:32.933425 32575 webserver.cc:460] Webserver started at http://127.20.132.193:34251/ using document root <none> and password file <none>
I20260811 14:26:32.933682 32575 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:32.933758 32575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:32.933930 32575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:32.935091 32575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "e84c5471505a47b08b4ea9a0fc129546"
format_stamp: "Formatted at 2026-08-11 14:26:32 on dist-test-slave-cbbz"
server_key: "f9a49a724bd1bee7cbcd1f9f4c756bec"
server_key_iv: "a4b3441f1f56a5d02f4c57992ea0cb1e"
server_key_version: "encryptionkey@0"
I20260811 14:26:32.935468 32575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "e84c5471505a47b08b4ea9a0fc129546"
format_stamp: "Formatted at 2026-08-11 14:26:32 on dist-test-slave-cbbz"
server_key: "f9a49a724bd1bee7cbcd1f9f4c756bec"
server_key_iv: "a4b3441f1f56a5d02f4c57992ea0cb1e"
server_key_version: "encryptionkey@0"
I20260811 14:26:32.937052 32575 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:26:32.937808 32591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:32.938021 32575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:26:32.938117 32575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "e84c5471505a47b08b4ea9a0fc129546"
format_stamp: "Formatted at 2026-08-11 14:26:32 on dist-test-slave-cbbz"
server_key: "f9a49a724bd1bee7cbcd1f9f4c756bec"
server_key_iv: "a4b3441f1f56a5d02f4c57992ea0cb1e"
server_key_version: "encryptionkey@0"
I20260811 14:26:32.938205 32575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:32.949852 32575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:32.951740 32575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:32.951910 32575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:32.952193 32575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:32.952529 32575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:32.952597 32575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:32.952642 32575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:32.952673 32575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:32.959264 32575 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:37765
I20260811 14:26:32.959299 32716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:37765 every 8 connection(s)
I20260811 14:26:32.959640 32575 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:26:32.962034 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 32575
I20260811 14:26:32.962160 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:26:32.962378 21011 external_mini_cluster.cc:1428] Setting key d38eb05861fb94cde1e735b5665f41c6
Aug 11 14:26:32 dist-test-slave-cbbz krb5kdc[32459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458392, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:32.969336 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:32.960393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:44739 (local address 127.20.132.254:37169)
0811 14:26:32.960469 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:32.960472 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:32.960686 (+ 214us) server_negotiation.cc:407] Connection header received
0811 14:26:32.961139 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:32.961140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:32.961153 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:32.961220 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:32.962165 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:32.962845 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:32.963935 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:32.964225 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:32.964308 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:32.966416 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:32.966417 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:32.966417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:32.966425 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:32.967847 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:32.968340 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:32.968341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:32.968342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:32.968404 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:32.968662 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:32.968663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:32.968663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:32.968779 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:32.968869 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:32.969158 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 14:26:32.969246 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:26:32.969521 32721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:32.960373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37169 (local address 127.20.132.193:44739)
0811 14:26:32.960530 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:32.960570 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:32.961053 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:32.961272 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:32.961275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:32.961873 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:32.962058 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:32.962063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:32.962945 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:32.962947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:32.963831 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:32.963834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:32.964315 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:32.964317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:32.964451 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:32.964985 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:32.964993 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:32.966318 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:32.967951 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:32.967958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:32.967960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:32.968265 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:32.968478 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:32.968479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:32.968480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:32.968594 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:32.968861 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:32.968868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:32.969005 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 14:26:32.969136 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 14:26:32.969291 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260811 14:26:32.970065 32718 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37169
I20260811 14:26:32.970180 32718 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:32.970386 32718 heartbeater.cc:511] Master 127.20.132.254:37169 requested a full tablet report, sending...
I20260811 14:26:32.971026 32508 ts_manager.cc:194] Registered new tserver with Master: e84c5471505a47b08b4ea9a0fc129546 (127.20.132.193:37765)
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
I20260811 14:26:32.971925 32508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:44739
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:26:32.990749 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37169
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:33.071722 32724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:33.071919 32724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:33.071943 32724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:33.073117 32724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:33.073165 32724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:33.073194 32724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:26:33.074640 32724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:33.074831 32724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:33.075006 32724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:26:33.079941 32729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:33.080044 32730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:33.080125 32732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:33.080062 32724 server_base.cc:1034] running on GCE node
I20260811 14:26:33.080427 32724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:33.080714 32724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:33.081857 32724 hybrid_clock.cc:648] HybridClock initialized: now 1786458393081848 us; error 26 us; skew 500 ppm
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[32459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458393, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:33.084312 32724 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:26:33.084693 32724 webserver.cc:460] Webserver started at http://127.20.132.194:41557/ using document root <none> and password file <none>
I20260811 14:26:33.084940 32724 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:33.085026 32724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:33.085188 32724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:33.086202 32724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "6766cc412e184d8abeed3da8905000df"
format_stamp: "Formatted at 2026-08-11 14:26:33 on dist-test-slave-cbbz"
server_key: "0eb37298f2e814a0df99c6adac5da942"
server_key_iv: "4f46cb519932971e3ce952d0f15d8345"
server_key_version: "encryptionkey@0"
I20260811 14:26:33.086544 32724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "6766cc412e184d8abeed3da8905000df"
format_stamp: "Formatted at 2026-08-11 14:26:33 on dist-test-slave-cbbz"
server_key: "0eb37298f2e814a0df99c6adac5da942"
server_key_iv: "4f46cb519932971e3ce952d0f15d8345"
server_key_version: "encryptionkey@0"
I20260811 14:26:33.087872 32724 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:26:33.088760 32741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:33.089018 32724 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:26:33.089116 32724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "6766cc412e184d8abeed3da8905000df"
format_stamp: "Formatted at 2026-08-11 14:26:33 on dist-test-slave-cbbz"
server_key: "0eb37298f2e814a0df99c6adac5da942"
server_key_iv: "4f46cb519932971e3ce952d0f15d8345"
server_key_version: "encryptionkey@0"
I20260811 14:26:33.089207 32724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:33.119654 32724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:33.121676 32724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:33.121835 32724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:33.122093 32724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:33.122403 32724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:33.122458 32724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:33.122498 32724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:33.122527 32724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:33.128609 32724 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:32807
I20260811 14:26:33.128655 397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:32807 every 8 connection(s)
I20260811 14:26:33.129019 32724 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[32459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458393, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:33.136075 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 32724
I20260811 14:26:33.136234 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:26:33.136471 21011 external_mini_cluster.cc:1428] Setting key 249958b2d8c23e8af5b3ec8786778368
I20260811 14:26:33.138655 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.129689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:56837 (local address 127.20.132.254:37169)
0811 14:26:33.129736 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.129738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.129950 (+ 212us) server_negotiation.cc:407] Connection header received
0811 14:26:33.130500 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.130502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.130515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.130581 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:33.131520 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.132036 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.133118 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.133429 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.133512 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.135580 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:33.135581 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:33.135582 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:33.135589 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:33.137299 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:33.137697 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:33.137698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:33.137698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:33.137753 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:33.138024 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:33.138024 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:33.138025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:33.138142 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:33.138214 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.138473 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.138572 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:26:33.138937 400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.129665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37169 (local address 127.20.132.194:56837)
0811 14:26:33.129823 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.129860 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.130382 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.130651 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.130655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.131228 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:33.131417 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.131421 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.132157 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.132158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.132985 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.132987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.133533 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.133534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.133683 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.134137 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:33.134145 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:33.135459 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:33.137374 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:33.137381 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:33.137383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:33.137606 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:33.137839 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:33.137840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:33.137840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:33.137950 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:33.138206 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:33.138212 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:33.138348 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.138453 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.138603 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260811 14:26:33.139403 398 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37169
I20260811 14:26:33.139513 398 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:33.139715 398 heartbeater.cc:511] Master 127.20.132.254:37169 requested a full tablet report, sending...
I20260811 14:26:33.140089 32508 ts_manager.cc:194] Registered new tserver with Master: 6766cc412e184d8abeed3da8905000df (127.20.132.194:32807)
I20260811 14:26:33.140486 32508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:56837
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:26:33.163636 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37169
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:26:33.254443 404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:26:33.254655 404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:26:33.254683 404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:26:33.256285 404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:26:33.256331 404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:26:33.256358 404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:26:33.258255 404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:26:33.258490 404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:26:33.258731 404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:26:33.264350 404 server_base.cc:1034] running on GCE node
W20260811 14:26:33.264362 409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:33.264426 411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:26:33.264483 413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:26:33.264701 404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:26:33.264957 404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:26:33.266139 404 hybrid_clock.cc:648] HybridClock initialized: now 1786458393266131 us; error 34 us; skew 500 ppm
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[32459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458393, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:26:33.268764 404 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:26:33.269217 404 webserver.cc:460] Webserver started at http://127.20.132.195:44251/ using document root <none> and password file <none>
I20260811 14:26:33.269426 404 fs_manager.cc:359] Metadata directory not provided
I20260811 14:26:33.269469 404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:26:33.269557 404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:26:33.270529 404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "5460e6f20e84485eae188f9f3b36b125"
format_stamp: "Formatted at 2026-08-11 14:26:33 on dist-test-slave-cbbz"
server_key: "7bf0ab4d6ba867af12811db43d0e8156"
server_key_iv: "fcf5a56ba6649fe6c8eab01a6d6e48ce"
server_key_version: "encryptionkey@0"
I20260811 14:26:33.270828 404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "5460e6f20e84485eae188f9f3b36b125"
format_stamp: "Formatted at 2026-08-11 14:26:33 on dist-test-slave-cbbz"
server_key: "7bf0ab4d6ba867af12811db43d0e8156"
server_key_iv: "fcf5a56ba6649fe6c8eab01a6d6e48ce"
server_key_version: "encryptionkey@0"
I20260811 14:26:33.272064 404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:26:33.272886 421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:33.273114 404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:26:33.273213 404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "5460e6f20e84485eae188f9f3b36b125"
format_stamp: "Formatted at 2026-08-11 14:26:33 on dist-test-slave-cbbz"
server_key: "7bf0ab4d6ba867af12811db43d0e8156"
server_key_iv: "fcf5a56ba6649fe6c8eab01a6d6e48ce"
server_key_version: "encryptionkey@0"
I20260811 14:26:33.273272 404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:26:33.294622 404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:26:33.296672 404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:26:33.296792 404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:26:33.296970 404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:26:33.297315 404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:26:33.297374 404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:33.297422 404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:26:33.297454 404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:26:33.303889 404 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:38665
I20260811 14:26:33.303966 547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:38665 every 8 connection(s)
I20260811 14:26:33.304356 404 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:26:33.309578 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 404
I20260811 14:26:33.309692 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:26:33.309883 21011 external_mini_cluster.cc:1428] Setting key 51da816741824d8538ab379e1724ab7c
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[32459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458393, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:26:33.314198 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.305153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:41569 (local address 127.20.132.254:37169)
0811 14:26:33.305203 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.305206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.305433 (+ 227us) server_negotiation.cc:407] Connection header received
0811 14:26:33.305909 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.305910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.305922 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.305980 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:33.306899 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.307454 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.308629 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.308820 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.308881 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.311374 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:33.311375 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:33.311375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:33.311384 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:33.312766 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:33.313183 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:33.313184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:33.313185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:33.313252 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:33.313512 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:33.313513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:33.313513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:33.313660 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:33.313735 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.314016 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.314109 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:26:33.314391 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.305136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37169 (local address 127.20.132.195:41569)
0811 14:26:33.305303 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.305339 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.305823 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.306030 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.306033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.306614 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:26:33.306804 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.306809 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.307581 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.307582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.308544 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.308547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.308903 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.308904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.309012 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.309543 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:26:33.309550 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:26:33.311277 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:26:33.312865 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:33.312873 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:33.312875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:33.313103 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:33.313328 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:26:33.313329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:26:33.313329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:26:33.313443 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:26:33.313738 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:26:33.313746 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:26:33.313885 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.313993 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.314159 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260811 14:26:33.314918 548 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37169
I20260811 14:26:33.315001 548 heartbeater.cc:464] Registering TS with master...
I20260811 14:26:33.315218 548 heartbeater.cc:511] Master 127.20.132.254:37169 requested a full tablet report, sending...
I20260811 14:26:33.315662 32508 ts_manager.cc:194] Registered new tserver with Master: 5460e6f20e84485eae188f9f3b36b125 (127.20.132.195:38665)
I20260811 14:26:33.315996 32508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:41569
I20260811 14:26:33.321902 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:26:33.330067 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.323257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51128 (local address 127.20.132.254:37169)
0811 14:26:33.323318 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.323320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.323446 (+ 126us) server_negotiation.cc:407] Connection header received
0811 14:26:33.323488 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.323488 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.323501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.323546 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:26:33.324035 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.324736 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.325839 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.326049 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.326129 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.327654 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:26:33.327655 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:26:33.327656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:26:33.327664 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:26:33.328858 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:33.329231 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:33.329233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:33.329233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:33.329310 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:26:33.329520 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:26:33.329520 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:26:33.329521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:26:33.329668 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:26:33.329777 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.329889 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.329966 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:26:33.331517 32508 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:26:33.333244 32508 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:26:33.339641 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.335606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:37765 (local address 127.0.0.1:56118)
0811 14:26:33.335956 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.335968 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.336061 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.336323 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.336326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.336328 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:33.336406 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.336408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.337456 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.337456 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.338577 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.338579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.339354 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.339355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.339432 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.339444 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.339514 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.339561 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":3,"thread_start_us":81,"threads_started":1}
I20260811 14:26:33.339674 563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.335698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56118 (local address 127.20.132.193:37765)
0811 14:26:33.335875 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.335880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.336031 (+ 151us) server_negotiation.cc:407] Connection header received
0811 14:26:33.336180 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.336184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.336202 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.336284 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:33.336515 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.337350 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.338655 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.339266 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.339341 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.339392 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.339543 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.339591 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260811 14:26:33.340188 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.335829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:38665 (local address 127.0.0.1:40220)
0811 14:26:33.336212 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.336222 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.336265 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.336698 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.336699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.336701 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:33.336748 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.336750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.337979 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.337980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.338908 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.338909 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.339948 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.339949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.340030 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.340035 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.340064 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.340102 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":88,"threads_started":1}
I20260811 14:26:33.340525 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.336052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40220 (local address 127.20.132.195:38665)
0811 14:26:33.336529 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.336534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.336542 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:26:33.336579 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.336582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.336605 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.336688 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:33.336812 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.337868 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.338997 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.339852 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.340302 (+ 450us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.340364 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.340392 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.340445 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":127,"threads_started":1}
I20260811 14:26:33.340416 32643 tablet_service.cc:1467] Processing CreateTablet for tablet c9be0086038c40d6939e1a4872a4665e (DEFAULT_TABLE table=test-table [id=c172426222be4d1987162aa0da01b1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:33.340809 32643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9be0086038c40d6939e1a4872a4665e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:33.341140 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.335606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:32807 (local address 127.0.0.1:36604)
0811 14:26:33.335721 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.335761 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.335821 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.336590 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.336591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.336593 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:33.336641 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.336643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.338984 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.338985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.339808 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.339811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.340899 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.340900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.340963 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.340967 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.341015 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.341051 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":67,"threads_started":1}
I20260811 14:26:33.341154 476 tablet_service.cc:1467] Processing CreateTablet for tablet c9be0086038c40d6939e1a4872a4665e (DEFAULT_TABLE table=test-table [id=c172426222be4d1987162aa0da01b1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:33.341372 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.335943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36604 (local address 127.20.132.194:32807)
0811 14:26:33.336197 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.336201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.336332 (+ 131us) server_negotiation.cc:407] Connection header received
0811 14:26:33.336399 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.336401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.336417 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.336506 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:33.336719 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.337866 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.339889 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.340744 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.340816 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.340865 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.341249 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.341294 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":93,"threads_started":1}
I20260811 14:26:33.341504 476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9be0086038c40d6939e1a4872a4665e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:33.343571 567 tablet_bootstrap.cc:492] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546: Bootstrap starting.
I20260811 14:26:33.343973 568 tablet_bootstrap.cc:492] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Bootstrap starting.
I20260811 14:26:33.344293 567 tablet_bootstrap.cc:654] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:33.344633 568 tablet_bootstrap.cc:654] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:33.344877 567 log.cc:824] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:33.344887 327 tablet_service.cc:1467] Processing CreateTablet for tablet c9be0086038c40d6939e1a4872a4665e (DEFAULT_TABLE table=test-table [id=c172426222be4d1987162aa0da01b1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:26:33.345223 327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9be0086038c40d6939e1a4872a4665e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:26:33.345264 568 log.cc:824] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:33.345801 567 tablet_bootstrap.cc:492] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546: No bootstrap required, opened a new log
I20260811 14:26:33.345875 567 ts_tablet_manager.cc:1397] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:26:33.346060 568 tablet_bootstrap.cc:492] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: No bootstrap required, opened a new log
I20260811 14:26:33.346146 568 ts_tablet_manager.cc:1397] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:26:33.347489 568 raft_consensus.cc:348] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.347638 568 raft_consensus.cc:374] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:33.347681 568 raft_consensus.cc:729] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5460e6f20e84485eae188f9f3b36b125, State: Initialized, Role: FOLLOWER
I20260811 14:26:33.347792 568 consensus_queue.cc:260] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.348093 568 ts_tablet_manager.cc:1428] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:26:33.347927 567 raft_consensus.cc:348] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.348097 548 heartbeater.cc:503] Master 127.20.132.254:37169 was elected leader, sending a full tablet report...
I20260811 14:26:33.348186 567 raft_consensus.cc:374] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:33.348230 567 raft_consensus.cc:729] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e84c5471505a47b08b4ea9a0fc129546, State: Initialized, Role: FOLLOWER
I20260811 14:26:33.348380 567 consensus_queue.cc:260] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.348652 567 ts_tablet_manager.cc:1428] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:26:33.348768 32718 heartbeater.cc:503] Master 127.20.132.254:37169 was elected leader, sending a full tablet report...
I20260811 14:26:33.349157 575 tablet_bootstrap.cc:492] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Bootstrap starting.
I20260811 14:26:33.349931 575 tablet_bootstrap.cc:654] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Neither blocks nor log segments found. Creating new log.
I20260811 14:26:33.350468 575 log.cc:824] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Log is configured to *not* fsync() on all Append() calls
I20260811 14:26:33.351073 575 tablet_bootstrap.cc:492] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: No bootstrap required, opened a new log
I20260811 14:26:33.351125 575 ts_tablet_manager.cc:1397] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:26:33.352563 575 raft_consensus.cc:348] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.352685 575 raft_consensus.cc:374] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:26:33.352707 575 raft_consensus.cc:729] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6766cc412e184d8abeed3da8905000df, State: Initialized, Role: FOLLOWER
I20260811 14:26:33.352779 575 consensus_queue.cc:260] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.353087 575 ts_tablet_manager.cc:1428] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:26:33.353117 398 heartbeater.cc:503] Master 127.20.132.254:37169 was elected leader, sending a full tablet report...
I20260811 14:26:33.356061 578 raft_consensus.cc:482] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:26:33.356180 578 raft_consensus.cc:504] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.356513 578 leader_election.cc:288] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e84c5471505a47b08b4ea9a0fc129546 (127.20.132.193:37765), 5460e6f20e84485eae188f9f3b36b125 (127.20.132.195:38665)
I20260811 14:26:33.360356 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.356852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:56521 (local address 127.20.132.195:38665)
0811 14:26:33.356891 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.356893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.356900 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:26:33.356920 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.356921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.356930 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.356990 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:33.357156 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.357874 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.359359 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.359957 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.360049 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.360060 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.360246 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.360290 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:33.360356 563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.356840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:38087 (local address 127.20.132.193:37765)
0811 14:26:33.356884 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.356886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.356896 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:26:33.356921 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.356921 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.356930 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.356990 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:26:33.357156 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.357868 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.359359 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.359955 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.360101 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.360110 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.360266 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.360299 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:26:33.360358 400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.356648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:37765 (local address 127.20.132.194:38087)
0811 14:26:33.356686 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.356697 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.356735 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.357001 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.357002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.357003 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:33.357068 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.357070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.357951 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.357951 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.359243 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.359245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.360109 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.360110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.360195 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.360198 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.360257 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.360288 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":77}
I20260811 14:26:33.360365 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.356668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:38665 (local address 127.20.132.194:56521)
0811 14:26:33.356809 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.356819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:26:33.356861 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:26:33.357000 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:26:33.357001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:26:33.357002 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:26:33.357068 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.357070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.357951 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.357951 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.359243 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:26:33.359245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.360052 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.360053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:26:33.360145 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.360177 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 14:26:33.360238 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 14:26:33.360281 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":52,"thread_start_us":81,"threads_started":1}
I20260811 14:26:33.360669 32668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9be0086038c40d6939e1a4872a4665e" candidate_uuid: "6766cc412e184d8abeed3da8905000df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e84c5471505a47b08b4ea9a0fc129546" is_pre_election: true
I20260811 14:26:33.360814 32668 raft_consensus.cc:2454] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6766cc412e184d8abeed3da8905000df in term 0.
I20260811 14:26:33.360777 497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9be0086038c40d6939e1a4872a4665e" candidate_uuid: "6766cc412e184d8abeed3da8905000df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5460e6f20e84485eae188f9f3b36b125" is_pre_election: true
I20260811 14:26:33.360939 497 raft_consensus.cc:2454] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6766cc412e184d8abeed3da8905000df in term 0.
I20260811 14:26:33.361074 32744 leader_election.cc:302] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6766cc412e184d8abeed3da8905000df, e84c5471505a47b08b4ea9a0fc129546; no voters:
I20260811 14:26:33.361213 578 raft_consensus.cc:2781] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:26:33.361279 578 raft_consensus.cc:482] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:26:33.361311 578 raft_consensus.cc:3037] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:33.361923 578 raft_consensus.cc:504] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.362064 578 leader_election.cc:288] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [CANDIDATE]: Term 1 election: Requested vote from peers e84c5471505a47b08b4ea9a0fc129546 (127.20.132.193:37765), 5460e6f20e84485eae188f9f3b36b125 (127.20.132.195:38665)
I20260811 14:26:33.362233 497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9be0086038c40d6939e1a4872a4665e" candidate_uuid: "6766cc412e184d8abeed3da8905000df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5460e6f20e84485eae188f9f3b36b125"
I20260811 14:26:33.362254 32668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9be0086038c40d6939e1a4872a4665e" candidate_uuid: "6766cc412e184d8abeed3da8905000df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e84c5471505a47b08b4ea9a0fc129546"
I20260811 14:26:33.362331 32668 raft_consensus.cc:3037] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:33.362331 497 raft_consensus.cc:3037] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:26:33.363219 32668 raft_consensus.cc:2454] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6766cc412e184d8abeed3da8905000df in term 1.
I20260811 14:26:33.363219 497 raft_consensus.cc:2454] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6766cc412e184d8abeed3da8905000df in term 1.
I20260811 14:26:33.363405 32746 leader_election.cc:302] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5460e6f20e84485eae188f9f3b36b125, 6766cc412e184d8abeed3da8905000df; no voters:
I20260811 14:26:33.363497 578 raft_consensus.cc:2781] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:26:33.363629 578 raft_consensus.cc:686] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 1 LEADER]: Becoming Leader. State: Replica: 6766cc412e184d8abeed3da8905000df, State: Running, Role: LEADER
I20260811 14:26:33.363723 578 consensus_queue.cc:237] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } }
I20260811 14:26:33.364465 32508 catalog_manager.cc:5495] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df reported cstate change: term changed from 0 to 1, leader changed from <none> to 6766cc412e184d8abeed3da8905000df (127.20.132.194). New cstate: current_term: 1 leader_uuid: "6766cc412e184d8abeed3da8905000df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6766cc412e184d8abeed3da8905000df" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260811 14:26:33.371330 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.369306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36612 (local address 127.20.132.194:32807)
0811 14:26:33.369365 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 14:26:33.369367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:26:33.369400 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:26:33.369434 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:26:33.369435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:26:33.369450 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:26:33.369498 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:26:33.369583 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.370004 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.370704 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:26:33.370879 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:26:33.370927 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:26:33.371058 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:26:33.371139 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:26:33.371197 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:26:33.371245 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 14:26:33.371261 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:26:33.372915 497 raft_consensus.cc:1261] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 1 FOLLOWER]: Refusing update from remote peer 6766cc412e184d8abeed3da8905000df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:33.372915 32668 raft_consensus.cc:1261] T c9be0086038c40d6939e1a4872a4665e P e84c5471505a47b08b4ea9a0fc129546 [term 1 FOLLOWER]: Refusing update from remote peer 6766cc412e184d8abeed3da8905000df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:26:33.373334 580 consensus_queue.cc:1035] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [LEADER]: Connected to new peer: Peer: permanent_uuid: "5460e6f20e84485eae188f9f3b36b125" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:33.373476 578 consensus_queue.cc:1035] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e84c5471505a47b08b4ea9a0fc129546" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:26:33.376832 584 mvcc.cc:205] Tried to move back new op lower bound from 7317333579253080064 to 7317333579218477056. Current Snapshot: MvccSnapshot[applied={T|T < 7317333579253080064}]
I20260811 14:26:33.377157 587 mvcc.cc:205] Tried to move back new op lower bound from 7317333579253080064 to 7317333579218477056. Current Snapshot: MvccSnapshot[applied={T|T < 7317333579253080064}]
I20260811 14:26:33.378811 32508 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:33.378911 32508 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:26:33.379637 32508 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff24db3b934644f2877e3f14c43b48ce: Sending DeleteTablet for 3 replicas of tablet c9be0086038c40d6939e1a4872a4665e
I20260811 14:26:33.379984 327 tablet_service.cc:1514] Processing DeleteTablet for tablet c9be0086038c40d6939e1a4872a4665e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:33 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36604
I20260811 14:26:33.380229 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 32575
I20260811 14:26:33.380260 32643 tablet_service.cc:1514] Processing DeleteTablet for tablet c9be0086038c40d6939e1a4872a4665e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:33 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:56118
I20260811 14:26:33.383078 595 tablet_replica.cc:330] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: stopping tablet replica
I20260811 14:26:33.383167 595 raft_consensus.cc:2229] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:26:33.383244 595 raft_consensus.cc:2258] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:33.384824 476 tablet_service.cc:1514] Processing DeleteTablet for tablet c9be0086038c40d6939e1a4872a4665e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:26:33 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:40220
I20260811 14:26:33.385074 596 tablet_replica.cc:330] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: stopping tablet replica
I20260811 14:26:33.385182 596 raft_consensus.cc:2229] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:26:33.385272 596 raft_consensus.cc:2258] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:26:33.385677 595 ts_tablet_manager.cc:1905] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:33.385838 596 ts_tablet_manager.cc:1905] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:26:33.387861 596 ts_tablet_manager.cc:1918] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:33.387943 596 log.cc:1196] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/c9be0086038c40d6939e1a4872a4665e
I20260811 14:26:33.387903 595 ts_tablet_manager.cc:1918] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:26:33.388181 595 log.cc:1196] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/c9be0086038c40d6939e1a4872a4665e
I20260811 14:26:33.388275 596 ts_tablet_manager.cc:1939] T c9be0086038c40d6939e1a4872a4665e P 5460e6f20e84485eae188f9f3b36b125: Deleting consensus metadata
I20260811 14:26:33.388594 595 ts_tablet_manager.cc:1939] T c9be0086038c40d6939e1a4872a4665e P 6766cc412e184d8abeed3da8905000df: Deleting consensus metadata
I20260811 14:26:33.388691 32495 catalog_manager.cc:4841] TS 5460e6f20e84485eae188f9f3b36b125 (127.20.132.195:38665): tablet c9be0086038c40d6939e1a4872a4665e (table test-table [id=c172426222be4d1987162aa0da01b1fc]) successfully deleted
I20260811 14:26:33.389074 32495 catalog_manager.cc:4841] TS 6766cc412e184d8abeed3da8905000df (127.20.132.194:32807): tablet c9be0086038c40d6939e1a4872a4665e (table test-table [id=c172426222be4d1987162aa0da01b1fc]) successfully deleted
W20260811 14:26:33.389854 32493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:37765 (error 108)
I20260811 14:26:33.390430 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:26:33.390291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:37765 (local address 127.0.0.1:56132)
0811 14:26:33.390352 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 14:26:33.390397 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:37765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 14:26:33.390516 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 32724
W20260811 14:26:33.390552 32493 catalog_manager.cc:4584] TS e84c5471505a47b08b4ea9a0fc129546 (127.20.132.193:37765): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c9be0086038c40d6939e1a4872a4665e: Network error: Client connection negotiation failed: client connection to 127.20.132.193:37765: connect: Connection refused (error 111)
I20260811 14:26:33.403620 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 404
I20260811 14:26:33.409718 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 32473
2026-08-11T14:26:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1996 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[600](info): set up 2 sockets
Aug 11 14:26:33 dist-test-slave-cbbz krb5kdc[600](info): commencing operation
krb5kdc: starting...
W20260811 14:26:34.508801 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:26:34 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:26:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:26:34Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/rangeradmin_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/rangeradmin_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/rangerlookup_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/rangerlookup_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
I20260811 14:26:34.682678 21011 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task2EBArE/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/postgres -l logfile start
2026-08-11 14:26:37.232 UTC [632] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 14:26:37.232 UTC [632] LOG: listening on IPv4 address "127.20.132.212", port 43543
2026-08-11 14:26:37.235 UTC [632] LOG: listening on Unix socket "/tmp/.s.PGSQL.43543"
2026-08-11 14:26:37.257 UTC [635] LOG: database system was shut down at 2026-08-11 14:26:35 UTC
2026-08-11 14:26:37.260 UTC [632] LOG: database system is ready to accept connections
I20260811 14:26:38.382036 21011 mini_postgres.cc:96] Postgres bound to 43543
2026-08-11 14:26:38.388 UTC [644] FATAL: database "slave" does not exist
127.20.132.212:43543 - accepting connections
I20260811 14:26:38.389454 21011 mini_ranger.cc:161] Starting Ranger...
I20260811 14:26:38.404987 21011 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 14:26:38.877717 21011 mini_ranger.cc:87] Created ranger Postgres database
I20260811 14:26:38.877808 21011 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-admin
2026-08-11 14:26:39,154 [I] DB FLAVOR :POSTGRES
2026-08-11 14:26:39,154 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 14:26:39,154 [I] Checking connection..
2026-08-11 14:26:39,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 14:26:39,417 [I] Checking connection passed.
2026-08-11 14:26:39,417 [I] --------- Verifying version history table ---------
2026-08-11 14:26:39,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:26:39,650 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 14:26:39,650 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:26:39,902 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 14:26:39,903 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 14:26:39,903 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 14:26:40.132 UTC [714] WARNING: there is no transaction in progress
2026-08-11 14:26:40,140 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 14:26:40,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:26:40,391 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 14:26:40,391 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 14:26:40,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 14:26:40,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 14:26:40,906 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-cbbz.c.gcp-upstream.internal','N') ;"
2026-08-11 14:26:41,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 14:26:41,435 [I] Table x_portal_user does not exist in database ranger
2026-08-11 14:26:41,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 14:26:41,677 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 14:26:41,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 14:26:41,944 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 14:26:42,206 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 14:26:42,206 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 14:26:43.173 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.190 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.205 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.220 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.235 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.252 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.304 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.311 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.325 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.335 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.345 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.358 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.367 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.374 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.381 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:43.388 UTC [832] WARNING: there is no transaction in progress
2026-08-11 14:26:44,008 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 14:26:44,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 14:26:44,268 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 14:26:44,268 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 14:26:44,524 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 14:26:44,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 14:26:44,778 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 14:26:44,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 14:26:45,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 14:26:45,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-cbbz.c.gcp-upstream.internal';"
2026-08-11 14:26:45,546 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 14:26:45,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 14:26:45,808 [I] DB_PATCHES have already been applied
I20260811 14:26:45.814604 21011 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-admin:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task2EBArE/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 14:26:45.814666 21011 mini_ranger.cc:193] Using host: 127.20.132.212
I20260811 14:26:45.818073 21011 mini_ranger.cc:227] Ranger admin URL: http://127.20.132.212:35035
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 2:26:46 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 14:26:47.011539 21011 mini_ranger.cc:160] Time spent starting Ranger: real 8.622s user 0.001s sys 0.009s
Aug 11, 2026 2:27:08 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 2:27:08 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 2:27:08 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 2:27:08 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 2:27:09 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 14:27:10.090914 21011 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/rangerkms_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/rangerkms_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.132.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.132.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 14:27:10 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458430, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 14:27:10.194234 21011 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 14:27:10.204751 21011 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 14:27:11.074329 21011 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 14:27:11.074419 21011 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms
I20260811 14:27:11.074442 21011 mini_ranger_kms.cc:227] Using postgres at 127.20.132.212:43543
2026-08-11 14:27:11,393 [I] DB FLAVOR :POSTGRES
2026-08-11 14:27:11,394 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 14:27:11,394 [I] Checking connection
2026-08-11 14:27:11,394 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 14:27:11,654 [I] connection success
2026-08-11 14:27:11,654 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 14:27:11,655 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 14:27:11,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 14:27:11,925 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 14:27:11,925 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 14:27:11,925 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 14:27:11,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:43543/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 14:27:12,178 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 14:27:12.669425 21011 mini_ranger_kms.cc:310] Created kms service
I20260811 14:27:12.866990 21011 mini_ranger_kms.cc:326] Created kudu user
I20260811 14:27:12.918994 21011 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 14:27:12 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458430, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:27:13.386233 21011 mini_ranger_kms.cc:384] Added ranger policy
I20260811 14:27:13.386350 21011 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms:/tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 14:27:13.386372 21011 mini_ranger_kms.cc:240] Using host: 127.20.132.212
I20260811 14:27:13.390437 21011 mini_ranger_kms.cc:276] Ranger KMS PID: 1034
I20260811 14:27:13.390554 21011 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.132.212:34639
Aug 11, 2026 2:27:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:27:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:27:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 2:27:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 2:27:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 2:27:14 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 14:27:15 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786458435, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.132.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:27:15.753626 21011 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.559s user 0.010s sys 0.291s
I20260811 14:27:15.753746 21011 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 14:27:15.753835 21011 mini_ranger_kms.cc:401] 127.20.132.212:34639/kms/v1/keys
Aug 11 14:27:16 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458435, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.132.212@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
Aug 11 14:27:16 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458435, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.132.212@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
Aug 11 14:27:18 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:27:18.723703 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37747
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:41825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37747
--ranger_config_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:34639/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:27:18.805421 1089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:27:18.805717 1089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:27:18.805756 1089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:27:18.806891 1089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:27:18.806957 1089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:27:18.806982 1089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:27:18.807010 1089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:27:18.807040 1089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:27:18.808704 1089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:41825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.132.212:34639/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37747
--ranger_config_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:27:18.808966 1089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:27:18.809194 1089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:27:18.814937 1094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:18.814947 1095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:18.814947 1097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:27:18.815398 1089 server_base.cc:1034] running on GCE node
I20260811 14:27:18.815658 1089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:27:18.815953 1089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:27:18.817117 1089 hybrid_clock.cc:648] HybridClock initialized: now 1786458438817080 us; error 54 us; skew 500 ppm
Aug 11 14:27:18 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458438, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:27:18.827507 1089 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:27:18.828012 1089 webserver.cc:460] Webserver started at http://127.20.132.254:43363/ using document root <none> and password file <none>
I20260811 14:27:18.828284 1089 fs_manager.cc:359] Metadata directory not provided
I20260811 14:27:18.828344 1089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:27:18.828496 1089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:27:18 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458438, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:27:18.882530 1089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "cef2f934c5ce430f9e61bc0166c7c828"
format_stamp: "Formatted at 2026-08-11 14:27:18 on dist-test-slave-cbbz"
server_key: "2230637c324f95167dea9cd2a9022753"
server_key_iv: "0fdbbb40faa7d543c7deb9c1686d96ae"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:18.882977 1089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "cef2f934c5ce430f9e61bc0166c7c828"
format_stamp: "Formatted at 2026-08-11 14:27:18 on dist-test-slave-cbbz"
server_key: "2230637c324f95167dea9cd2a9022753"
server_key_iv: "0fdbbb40faa7d543c7deb9c1686d96ae"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:18.884789 1089 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 14:27:18.896749 1104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:18.896938 1089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:27:18.897063 1089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "cef2f934c5ce430f9e61bc0166c7c828"
format_stamp: "Formatted at 2026-08-11 14:27:18 on dist-test-slave-cbbz"
server_key: "2230637c324f95167dea9cd2a9022753"
server_key_iv: "0fdbbb40faa7d543c7deb9c1686d96ae"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:18.897179 1089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:27:18.915397 1089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:27:18.917483 1089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:27:18.917670 1089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:27:18.922598 1089 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37747
I20260811 14:27:18.922619 1159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37747 every 8 connection(s)
I20260811 14:27:18.923030 1089 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:27:18.923813 1160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:27:18.926985 1160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828: Bootstrap starting.
I20260811 14:27:18.927680 1160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828: Neither blocks nor log segments found. Creating new log.
I20260811 14:27:18.928002 1160 log.cc:824] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828: Log is configured to *not* fsync() on all Append() calls
I20260811 14:27:18.928797 1160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828: No bootstrap required, opened a new log
I20260811 14:27:18.930157 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 1089
I20260811 14:27:18.930272 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:27:18.930465 21011 external_mini_cluster.cc:1428] Setting key 081a49561865bf3c57c0b6f883280d79
I20260811 14:27:18.931787 1160 raft_consensus.cc:348] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef2f934c5ce430f9e61bc0166c7c828" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37747 } }
I20260811 14:27:18.931996 1160 raft_consensus.cc:374] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:27:18.932065 1160 raft_consensus.cc:729] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cef2f934c5ce430f9e61bc0166c7c828, State: Initialized, Role: FOLLOWER
I20260811 14:27:18.932250 1160 consensus_queue.cc:260] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef2f934c5ce430f9e61bc0166c7c828" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37747 } }
I20260811 14:27:18.932336 1160 raft_consensus.cc:388] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:27:18.932368 1160 raft_consensus.cc:482] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:27:18.932435 1160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:27:18.933120 1160 raft_consensus.cc:504] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef2f934c5ce430f9e61bc0166c7c828" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37747 } }
I20260811 14:27:18.933229 1160 leader_election.cc:302] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cef2f934c5ce430f9e61bc0166c7c828; no voters:
I20260811 14:27:18.933422 1160 leader_election.cc:288] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:27:18.933470 1166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:27:18.933689 1166 raft_consensus.cc:686] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [term 1 LEADER]: Becoming Leader. State: Replica: cef2f934c5ce430f9e61bc0166c7c828, State: Running, Role: LEADER
I20260811 14:27:18.933749 1160 sys_catalog.cc:564] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:27:18.933861 1166 consensus_queue.cc:237] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef2f934c5ce430f9e61bc0166c7c828" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37747 } }
I20260811 14:27:18.935055 1166 sys_catalog.cc:455] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cef2f934c5ce430f9e61bc0166c7c828. Latest consensus state: current_term: 1 leader_uuid: "cef2f934c5ce430f9e61bc0166c7c828" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef2f934c5ce430f9e61bc0166c7c828" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37747 } } }
I20260811 14:27:18.935212 1166 sys_catalog.cc:458] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [sys.catalog]: This master's current role is: LEADER
I20260811 14:27:18.935467 1160 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 14:27:18.935943 1170 sys_catalog.cc:455] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cef2f934c5ce430f9e61bc0166c7c828" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef2f934c5ce430f9e61bc0166c7c828" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37747 } } }
I20260811 14:27:18.936025 1170 sys_catalog.cc:458] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828 [sys.catalog]: This master's current role is: LEADER
I20260811 14:27:18.936044 1184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 14:27:18 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:27:18.939054 1184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:27:18.946206 1165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:18.930979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48880 (local address 127.20.132.254:37747)
0811 14:27:18.931129 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:18.931140 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:18.931280 (+ 140us) server_negotiation.cc:407] Connection header received
0811 14:27:18.931759 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:18.931765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:18.931811 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:18.931943 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:27:18.932743 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:18.933973 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:18.934826 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:18.935457 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:18.935562 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:18.938888 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:27:18.938959 (+ 71us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:27:18.938959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:27:18.939060 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:27:18.944104 (+ 5044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:18.944530 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:18.944533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:18.944534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:18.944664 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:18.944859 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:18.944860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:18.944860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:18.945219 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:27:18.945390 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:18.945467 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 14:27:18.945628 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260811 14:27:18.952323 1184 catalog_manager.cc:1347] Generated new cluster ID: a6045dd7ff434950bb508e9b04552338
I20260811 14:27:18.952399 1184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:27:18.974583 1184 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:27:18.975512 1184 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:27:18.984315 1184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828: Generated new TSK 0
I20260811 14:27:18.984632 1184 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:27:19.715546 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:34639/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37747
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:41825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:27:19.802862 1215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:27:19.803089 1215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:27:19.803130 1215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:27:19.804376 1215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:27:19.804435 1215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:27:19.804481 1215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:27:19.805948 1215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:41825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.132.212:34639/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:27:19.806212 1215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:27:19.806481 1215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:27:19.811648 1224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:19.811655 1221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:27:19.811764 1215 server_base.cc:1034] running on GCE node
W20260811 14:27:19.811879 1222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:27:19.812101 1215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:27:19.812428 1215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:27:19.813622 1215 hybrid_clock.cc:648] HybridClock initialized: now 1786458439813605 us; error 41 us; skew 500 ppm
Aug 11 14:27:19 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458439, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:27:19.816608 1215 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:27:19.817060 1215 webserver.cc:460] Webserver started at http://127.20.132.193:38607/ using document root <none> and password file <none>
I20260811 14:27:19.817301 1215 fs_manager.cc:359] Metadata directory not provided
I20260811 14:27:19.817363 1215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:27:19.817512 1215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:27:19 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458439, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:27:19.828231 1215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "1fe559d58a624c47a250c3e70a5b5d0a"
format_stamp: "Formatted at 2026-08-11 14:27:19 on dist-test-slave-cbbz"
server_key: "f8503f5e2dcb8b9acedfb6ed61e57332"
server_key_iv: "ed4363f9bd2ff651c0b5f6ef6a15ffe7"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:19.828791 1215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "1fe559d58a624c47a250c3e70a5b5d0a"
format_stamp: "Formatted at 2026-08-11 14:27:19 on dist-test-slave-cbbz"
server_key: "f8503f5e2dcb8b9acedfb6ed61e57332"
server_key_iv: "ed4363f9bd2ff651c0b5f6ef6a15ffe7"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:19.830597 1215 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 14:27:19.844835 1231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:19.845118 1215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:27:19.845228 1215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "1fe559d58a624c47a250c3e70a5b5d0a"
format_stamp: "Formatted at 2026-08-11 14:27:19 on dist-test-slave-cbbz"
server_key: "f8503f5e2dcb8b9acedfb6ed61e57332"
server_key_iv: "ed4363f9bd2ff651c0b5f6ef6a15ffe7"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:19.845322 1215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:27:19.861694 1215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:27:19.864066 1215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:27:19.864297 1215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:27:19.864559 1215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:27:19.864935 1215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:27:19.865018 1215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:19.865068 1215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:27:19.865100 1215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:19.872731 1215 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:44015
I20260811 14:27:19.872849 1354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:44015 every 8 connection(s)
I20260811 14:27:19.873205 1215 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:27:19.878274 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 1215
I20260811 14:27:19.878383 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:27:19.878569 21011 external_mini_cluster.cc:1428] Setting key d27a157407e1a1b0e4f59cc74bcf5918
Aug 11 14:27:19 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458439, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:27:19.886796 1359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:19.874010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:43119 (local address 127.20.132.254:37747)
0811 14:27:19.874173 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:19.874176 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:19.874388 (+ 212us) server_negotiation.cc:407] Connection header received
0811 14:27:19.875136 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:19.875138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:19.875154 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:19.875208 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:27:19.876100 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:19.876904 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:19.878354 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:19.878682 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:19.878730 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:19.881191 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:27:19.881193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:27:19.881194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:27:19.881202 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:27:19.885343 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:19.885786 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:19.885788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:19.885788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:19.885853 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:19.886133 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:19.886134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:19.886135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:19.886253 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:27:19.886330 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:19.886609 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 14:27:19.886699 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260811 14:27:19.887146 1358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:19.873979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37747 (local address 127.20.132.193:43119)
0811 14:27:19.874250 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:19.874299 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:19.874995 (+ 696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:19.875402 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:19.875407 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:19.875702 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:27:19.875983 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:19.875990 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:19.877029 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:19.877030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:19.878242 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:19.878245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:19.878822 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:19.878823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:19.878940 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:19.879456 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:27:19.879464 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:27:19.881046 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:27:19.885440 (+ 4394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:27:19.885449 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:27:19.885452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:27:19.885692 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:27:19.885924 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:27:19.885925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:27:19.885925 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:27:19.886057 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:27:19.886321 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:27:19.886328 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:27:19.886475 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 14:27:19.886585 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 14:27:19.886735 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":87,"threads_started":1}
I20260811 14:27:19.887627 1355 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37747
I20260811 14:27:19.887744 1355 heartbeater.cc:464] Registering TS with master...
I20260811 14:27:19.887930 1355 heartbeater.cc:511] Master 127.20.132.254:37747 requested a full tablet report, sending...
I20260811 14:27:19.888468 1124 ts_manager.cc:194] Registered new tserver with Master: 1fe559d58a624c47a250c3e70a5b5d0a (127.20.132.193:44015)
I20260811 14:27:19.889176 1124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:43119
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:27:19.921401 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:34639/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37747
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:41825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:27:20.046406 1364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:27:20.046754 1364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:27:20.046841 1364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:27:20.048676 1364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:27:20.048799 1364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:27:20.048895 1364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:27:20.051069 1364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:41825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.132.212:34639/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:27:20.051564 1364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:27:20.051915 1364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:27:20.066517 1375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:20.067310 1377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:20.067543 1371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:27:20.068241 1364 server_base.cc:1034] running on GCE node
I20260811 14:27:20.068465 1364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:27:20.068746 1364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:27:20.069941 1364 hybrid_clock.cc:648] HybridClock initialized: now 1786458440069914 us; error 39 us; skew 500 ppm
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:27:20.073472 1364 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:27:20.074062 1364 webserver.cc:460] Webserver started at http://127.20.132.194:43777/ using document root <none> and password file <none>
I20260811 14:27:20.074324 1364 fs_manager.cc:359] Metadata directory not provided
I20260811 14:27:20.074384 1364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:27:20.074513 1364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:27:20.089206 1364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "2d6fa2237f5b4b08a78f4ac183ce309f"
format_stamp: "Formatted at 2026-08-11 14:27:20 on dist-test-slave-cbbz"
server_key: "dd4d11195ce9a3783b9bcfed16f3666c"
server_key_iv: "a39582f0d6b49976f0e8b7609ad0c955"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:20.089805 1364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "2d6fa2237f5b4b08a78f4ac183ce309f"
format_stamp: "Formatted at 2026-08-11 14:27:20 on dist-test-slave-cbbz"
server_key: "dd4d11195ce9a3783b9bcfed16f3666c"
server_key_iv: "a39582f0d6b49976f0e8b7609ad0c955"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:20.095175 1364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.000s
I20260811 14:27:20.111464 1385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:20.112274 1364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 14:27:20.112460 1364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "2d6fa2237f5b4b08a78f4ac183ce309f"
format_stamp: "Formatted at 2026-08-11 14:27:20 on dist-test-slave-cbbz"
server_key: "dd4d11195ce9a3783b9bcfed16f3666c"
server_key_iv: "a39582f0d6b49976f0e8b7609ad0c955"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:20.112637 1364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:27:20.128057 1364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:27:20.130595 1364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:27:20.130825 1364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:27:20.131126 1364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:27:20.131551 1364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:27:20.131660 1364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:20.131749 1364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:27:20.131816 1364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:20.138734 1364 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:44279
I20260811 14:27:20.139267 1364 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:27:20.141170 1512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:44279 every 8 connection(s)
I20260811 14:27:20.144114 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 1364
I20260811 14:27:20.144261 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:27:20.144449 21011 external_mini_cluster.cc:1428] Setting key f7673b3376c3895211b1e5c73cd94c46
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:27:20.156291 1359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.142555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:51977 (local address 127.20.132.254:37747)
0811 14:27:20.142622 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.142625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.142844 (+ 219us) server_negotiation.cc:407] Connection header received
0811 14:27:20.143563 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.143565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.143582 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.143629 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:27:20.147242 (+ 3613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.148024 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.149559 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.149883 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.149927 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.152775 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:27:20.152777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:27:20.152777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:27:20.152785 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:27:20.154602 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:20.155120 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:20.155122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:20.155122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:20.155184 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:20.155467 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:20.155469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:20.155469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:20.155620 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:27:20.155673 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.156051 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.156181 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:27:20.157099 1516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.142557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37747 (local address 127.20.132.194:51977)
0811 14:27:20.142720 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.142761 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.143428 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.143820 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.143835 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.144896 (+ 1061us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:27:20.147119 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.147126 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.148177 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.148178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.149452 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.149455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.150021 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.150022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.150163 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.150837 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:27:20.150847 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:27:20.152662 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:27:20.154720 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:27:20.154728 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:27:20.154730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:27:20.155030 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:27:20.155255 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:27:20.155255 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:27:20.155256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:27:20.155390 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:27:20.155708 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:27:20.155714 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:27:20.155892 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.156674 (+ 782us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.156855 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260811 14:27:20.157811 1513 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37747
I20260811 14:27:20.157912 1513 heartbeater.cc:464] Registering TS with master...
I20260811 14:27:20.158149 1513 heartbeater.cc:511] Master 127.20.132.254:37747 requested a full tablet report, sending...
I20260811 14:27:20.158593 1124 ts_manager.cc:194] Registered new tserver with Master: 2d6fa2237f5b4b08a78f4ac183ce309f (127.20.132.194:44279)
I20260811 14:27:20.159083 1124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:51977
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:27:20.197227 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:34639/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37747
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:41825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:27:20.314371 1519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:27:20.314716 1519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:27:20.314803 1519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:27:20.316502 1519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:27:20.316605 1519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:27:20.316681 1519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:27:20.318727 1519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:41825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.132.212:34639/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:27:20.319404 1519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:27:20.319715 1519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:27:20.326553 1528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:20.326593 1531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:27:20.326838 1533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:27:20.328025 1519 server_base.cc:1034] running on GCE node
I20260811 14:27:20.328260 1519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:27:20.328558 1519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:27:20.331702 1519 hybrid_clock.cc:648] HybridClock initialized: now 1786458440331679 us; error 33 us; skew 500 ppm
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:27:20.335312 1519 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:27:20.335819 1519 webserver.cc:460] Webserver started at http://127.20.132.195:39661/ using document root <none> and password file <none>
I20260811 14:27:20.336058 1519 fs_manager.cc:359] Metadata directory not provided
I20260811 14:27:20.336131 1519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:27:20.336442 1519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:27:20.351799 1519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "3c9b1f683bf9496081a65fc2e28190c8"
format_stamp: "Formatted at 2026-08-11 14:27:20 on dist-test-slave-cbbz"
server_key: "ca13cc968d1fc6eddc7a7a200415064b"
server_key_iv: "4cc8271c5f0eec1019d2ec533b43c190"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:20.352344 1519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "3c9b1f683bf9496081a65fc2e28190c8"
format_stamp: "Formatted at 2026-08-11 14:27:20 on dist-test-slave-cbbz"
server_key: "ca13cc968d1fc6eddc7a7a200415064b"
server_key_iv: "4cc8271c5f0eec1019d2ec533b43c190"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:20.357224 1519 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.001s
I20260811 14:27:20.375584 1541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:20.375865 1519 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 14:27:20.375964 1519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "3c9b1f683bf9496081a65fc2e28190c8"
format_stamp: "Formatted at 2026-08-11 14:27:20 on dist-test-slave-cbbz"
server_key: "ca13cc968d1fc6eddc7a7a200415064b"
server_key_iv: "4cc8271c5f0eec1019d2ec533b43c190"
server_key_version: "kuduclusterkey@0"
I20260811 14:27:20.376055 1519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:27:20.392549 1519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:27:20.395038 1519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:27:20.395251 1519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:27:20.395484 1519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:27:20.395905 1519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:27:20.395994 1519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:20.396067 1519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:27:20.396126 1519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:27:20.403017 1519 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43771
I20260811 14:27:20.403496 1519 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:27:20.407321 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 1519
I20260811 14:27:20.407440 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:27:20.407648 21011 external_mini_cluster.cc:1428] Setting key e039e6bca735ecc7f650500a2e3f2c61
I20260811 14:27:20.408696 1670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43771 every 8 connection(s)
Aug 11 14:27:20 dist-test-slave-cbbz krb5kdc[600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:27:20.420040 1359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.409349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:35237 (local address 127.20.132.254:37747)
0811 14:27:20.409399 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.409401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.409738 (+ 337us) server_negotiation.cc:407] Connection header received
0811 14:27:20.410420 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.410422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.410434 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.410499 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:27:20.411254 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.412064 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.413605 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.413942 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.413992 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.416696 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:27:20.416698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:27:20.416698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:27:20.416705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:27:20.418416 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:20.418937 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:20.418938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:20.418939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:20.419000 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:20.419294 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:20.419295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:20.419296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:20.419432 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:27:20.419476 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.419855 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.419947 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:27:20.420814 1673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.409351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37747 (local address 127.20.132.195:35237)
0811 14:27:20.409606 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.409650 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.410316 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.410568 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.410572 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.410836 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:27:20.411115 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.411121 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.412218 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.412219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.413494 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.413497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.414089 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.414090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.414232 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.414845 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:27:20.414855 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:27:20.416571 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:27:20.418515 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:27:20.418521 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:27:20.418523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:27:20.418836 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:27:20.419076 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:27:20.419077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:27:20.419077 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:27:20.419208 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:27:20.419524 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:27:20.419530 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:27:20.419693 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.420400 (+ 707us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.420564 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":85,"threads_started":1}
I20260811 14:27:20.421447 1671 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37747
I20260811 14:27:20.421535 1671 heartbeater.cc:464] Registering TS with master...
I20260811 14:27:20.421731 1671 heartbeater.cc:511] Master 127.20.132.254:37747 requested a full tablet report, sending...
I20260811 14:27:20.422142 1124 ts_manager.cc:194] Registered new tserver with Master: 3c9b1f683bf9496081a65fc2e28190c8 (127.20.132.195:43771)
I20260811 14:27:20.422631 1124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:35237
I20260811 14:27:20.430042 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:27:20.440961 1359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.432908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.20.132.254:37747)
0811 14:27:20.432950 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.432952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.433202 (+ 250us) server_negotiation.cc:407] Connection header received
0811 14:27:20.433298 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.433299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.433309 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.433338 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:27:20.434138 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.434922 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.436015 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.436331 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.436380 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.437976 (+ 1596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:27:20.437977 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:27:20.437977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:27:20.437984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:27:20.439665 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:20.440068 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:20.440069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:20.440070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:20.440123 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:27:20.440368 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:27:20.440369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:27:20.440369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:27:20.440490 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:27:20.440563 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.440790 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.440866 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:27:20.443179 1124 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:27:20.444986 1124 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:27:20.453110 1686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.447313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43771 (local address 127.0.0.1:59380)
0811 14:27:20.448274 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.448284 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.448411 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.448713 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.448716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.448719 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:27:20.448791 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.448793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.450198 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.450199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.451652 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.451655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.452794 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.452795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.452875 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.452890 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.452963 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.453021 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":946,"mutex_wait_us":25,"thread_start_us":87,"threads_started":1}
I20260811 14:27:20.453207 1685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.447313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:44279 (local address 127.0.0.1:54484)
0811 14:27:20.447926 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.447969 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.448510 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.448948 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.448949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.448950 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:27:20.448983 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.448984 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.450508 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.450508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.451654 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.451655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.453008 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.453009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.453058 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.453062 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.453091 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.453142 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":6,"thread_start_us":91,"threads_started":1}
I20260811 14:27:20.453655 1687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.447603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59380 (local address 127.20.132.195:43771)
0811 14:27:20.447854 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.447859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.448365 (+ 506us) server_negotiation.cc:407] Connection header received
0811 14:27:20.448523 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.448526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.448544 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.448624 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:27:20.448880 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.450100 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.451780 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.452613 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.452700 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.452757 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.453507 (+ 750us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.453553 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":96,"threads_started":1}
I20260811 14:27:20.454135 1688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.447853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54484 (local address 127.20.132.194:44279)
0811 14:27:20.448780 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.448785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.448795 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:27:20.448832 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.448834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.448850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.449050 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:27:20.449114 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.450417 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.451784 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.452919 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.453302 (+ 383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.453365 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.453392 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.453433 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":888,"thread_start_us":83,"threads_started":1}
I20260811 14:27:20.454417 1596 tablet_service.cc:1467] Processing CreateTablet for tablet be086c3edd0d40bd80c515b35aa4a542 (DEFAULT_TABLE table=test-table [id=568596c6aabd4924b6c7bace1d4a7d00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:27:20.454794 1596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be086c3edd0d40bd80c515b35aa4a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:27:20.454840 1420 tablet_service.cc:1467] Processing CreateTablet for tablet be086c3edd0d40bd80c515b35aa4a542 (DEFAULT_TABLE table=test-table [id=568596c6aabd4924b6c7bace1d4a7d00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:27:20.455152 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be086c3edd0d40bd80c515b35aa4a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:27:20.455252 1684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.447541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44015 (local address 127.0.0.1:32798)
0811 14:27:20.448596 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.448606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.448643 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.451711 (+ 3068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.451712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.451714 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:27:20.451763 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.451764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.453050 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.453051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.454114 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.454117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.455032 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.455033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.455091 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.455096 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.455137 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.455177 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"thread_start_us":79,"threads_started":1}
I20260811 14:27:20.455639 1689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.448034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32798 (local address 127.20.132.193:44015)
0811 14:27:20.451518 (+ 3484us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.451523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.451535 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:27:20.451571 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.451573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.451590 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.451839 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:27:20.451905 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.452942 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.454230 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.454928 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.455422 (+ 494us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.455488 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.455515 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.455558 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3447,"thread_start_us":60,"threads_started":1}
I20260811 14:27:20.456230 1275 tablet_service.cc:1467] Processing CreateTablet for tablet be086c3edd0d40bd80c515b35aa4a542 (DEFAULT_TABLE table=test-table [id=568596c6aabd4924b6c7bace1d4a7d00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:27:20.456542 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be086c3edd0d40bd80c515b35aa4a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:27:20.459151 1691 tablet_bootstrap.cc:492] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Bootstrap starting.
I20260811 14:27:20.459702 1692 tablet_bootstrap.cc:492] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a: Bootstrap starting.
I20260811 14:27:20.460057 1691 tablet_bootstrap.cc:654] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Neither blocks nor log segments found. Creating new log.
I20260811 14:27:20.460161 1690 tablet_bootstrap.cc:492] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Bootstrap starting.
I20260811 14:27:20.460541 1691 log.cc:824] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Log is configured to *not* fsync() on all Append() calls
I20260811 14:27:20.460574 1692 tablet_bootstrap.cc:654] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a: Neither blocks nor log segments found. Creating new log.
I20260811 14:27:20.460882 1692 log.cc:824] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a: Log is configured to *not* fsync() on all Append() calls
I20260811 14:27:20.461175 1690 tablet_bootstrap.cc:654] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Neither blocks nor log segments found. Creating new log.
I20260811 14:27:20.461534 1691 tablet_bootstrap.cc:492] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: No bootstrap required, opened a new log
I20260811 14:27:20.461601 1691 ts_tablet_manager.cc:1397] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:27:20.461635 1690 log.cc:824] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Log is configured to *not* fsync() on all Append() calls
I20260811 14:27:20.461719 1692 tablet_bootstrap.cc:492] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a: No bootstrap required, opened a new log
I20260811 14:27:20.461786 1692 ts_tablet_manager.cc:1397] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:27:20.462634 1690 tablet_bootstrap.cc:492] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: No bootstrap required, opened a new log
I20260811 14:27:20.462713 1690 ts_tablet_manager.cc:1397] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:27:20.463768 1691 raft_consensus.cc:348] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.463945 1691 raft_consensus.cc:374] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:27:20.463984 1691 raft_consensus.cc:729] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6fa2237f5b4b08a78f4ac183ce309f, State: Initialized, Role: FOLLOWER
I20260811 14:27:20.464104 1691 consensus_queue.cc:260] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.464406 1691 ts_tablet_manager.cc:1428] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:27:20.464520 1513 heartbeater.cc:503] Master 127.20.132.254:37747 was elected leader, sending a full tablet report...
I20260811 14:27:20.465229 1692 raft_consensus.cc:348] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.465212 1690 raft_consensus.cc:348] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.465382 1692 raft_consensus.cc:374] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:27:20.465411 1692 raft_consensus.cc:729] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fe559d58a624c47a250c3e70a5b5d0a, State: Initialized, Role: FOLLOWER
I20260811 14:27:20.465401 1690 raft_consensus.cc:374] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:27:20.465442 1690 raft_consensus.cc:729] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9b1f683bf9496081a65fc2e28190c8, State: Initialized, Role: FOLLOWER
I20260811 14:27:20.465512 1692 consensus_queue.cc:260] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.465577 1690 consensus_queue.cc:260] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.465785 1692 ts_tablet_manager.cc:1428] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260811 14:27:20.465821 1355 heartbeater.cc:503] Master 127.20.132.254:37747 was elected leader, sending a full tablet report...
I20260811 14:27:20.466360 1690 ts_tablet_manager.cc:1428] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 14:27:20.466727 1671 heartbeater.cc:503] Master 127.20.132.254:37747 was elected leader, sending a full tablet report...
I20260811 14:27:20.523684 1696 raft_consensus.cc:482] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:27:20.523890 1696 raft_consensus.cc:504] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.526338 1696 leader_election.cc:288] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c9b1f683bf9496081a65fc2e28190c8 (127.20.132.195:43771), 1fe559d58a624c47a250c3e70a5b5d0a (127.20.132.193:44015)
I20260811 14:27:20.528568 1516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.524501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43771 (local address 127.20.132.194:38191)
0811 14:27:20.524609 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.524621 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.524664 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.524934 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.524935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.524937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:27:20.525009 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.525011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.525990 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.525992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.527347 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.527350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.528311 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.528312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.528400 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.528403 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.528452 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.528496 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 14:27:20.529026 1687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.524743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:38191 (local address 127.20.132.195:43771)
0811 14:27:20.524791 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.524793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.524801 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:27:20.524826 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.524827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.524837 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.524883 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:27:20.525090 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.525852 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.527624 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.528188 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.528265 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.528275 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.528923 (+ 648us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.528964 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:27:20.529289 1617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be086c3edd0d40bd80c515b35aa4a542" candidate_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9b1f683bf9496081a65fc2e28190c8" is_pre_election: true
I20260811 14:27:20.529443 1617 raft_consensus.cc:2454] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6fa2237f5b4b08a78f4ac183ce309f in term 0.
I20260811 14:27:20.529738 1387 leader_election.cc:302] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6fa2237f5b4b08a78f4ac183ce309f, 3c9b1f683bf9496081a65fc2e28190c8; no voters:
I20260811 14:27:20.529912 1696 raft_consensus.cc:2781] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:27:20.529956 1696 raft_consensus.cc:482] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:27:20.529976 1696 raft_consensus.cc:3037] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:27:20.530989 1696 raft_consensus.cc:504] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.531126 1696 leader_election.cc:288] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [CANDIDATE]: Term 1 election: Requested vote from peers 3c9b1f683bf9496081a65fc2e28190c8 (127.20.132.195:43771), 1fe559d58a624c47a250c3e70a5b5d0a (127.20.132.193:44015)
I20260811 14:27:20.531658 1617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be086c3edd0d40bd80c515b35aa4a542" candidate_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9b1f683bf9496081a65fc2e28190c8"
I20260811 14:27:20.531754 1617 raft_consensus.cc:3037] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:27:20.531973 1689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.526709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:44465 (local address 127.20.132.193:44015)
0811 14:27:20.527488 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.527491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.527500 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:27:20.527530 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.527531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.527544 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.527613 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:27:20.528469 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.529269 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.530842 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.531521 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.531580 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.531590 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.531845 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.531897 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748}
I20260811 14:27:20.532330 1700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.526135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44015 (local address 127.20.132.194:44465)
0811 14:27:20.526501 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.526513 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:27:20.526567 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:27:20.528226 (+ 1659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:27:20.528227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:27:20.528230 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:27:20.528343 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.528345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.529392 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.529393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.530715 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:27:20.530718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.531663 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.531664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:27:20.531742 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.531746 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:27:20.532174 (+ 428us) client_negotiation.cc:240] Negotiation successful
0811 14:27:20.532223 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":116,"threads_started":1}
I20260811 14:27:20.532757 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be086c3edd0d40bd80c515b35aa4a542" candidate_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" is_pre_election: true
I20260811 14:27:20.532828 1617 raft_consensus.cc:2454] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6fa2237f5b4b08a78f4ac183ce309f in term 1.
I20260811 14:27:20.532950 1305 raft_consensus.cc:2454] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6fa2237f5b4b08a78f4ac183ce309f in term 0.
I20260811 14:27:20.532997 1387 leader_election.cc:302] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6fa2237f5b4b08a78f4ac183ce309f, 3c9b1f683bf9496081a65fc2e28190c8; no voters:
I20260811 14:27:20.533106 1696 raft_consensus.cc:2781] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:27:20.533108 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be086c3edd0d40bd80c515b35aa4a542" candidate_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fe559d58a624c47a250c3e70a5b5d0a"
I20260811 14:27:20.533195 1304 raft_consensus.cc:3037] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:27:20.533283 1696 raft_consensus.cc:686] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 1 LEADER]: Becoming Leader. State: Replica: 2d6fa2237f5b4b08a78f4ac183ce309f, State: Running, Role: LEADER
I20260811 14:27:20.533375 1696 consensus_queue.cc:237] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } }
I20260811 14:27:20.534200 1123 catalog_manager.cc:5495] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6fa2237f5b4b08a78f4ac183ce309f (127.20.132.194). New cstate: current_term: 1 leader_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6fa2237f5b4b08a78f4ac183ce309f" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 } health_report { overall_health: UNKNOWN } } }
I20260811 14:27:20.534344 1304 raft_consensus.cc:2454] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6fa2237f5b4b08a78f4ac183ce309f in term 1.
I20260811 14:27:20.548126 1688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.544345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54486 (local address 127.20.132.194:44279)
0811 14:27:20.544394 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 14:27:20.544396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:27:20.544405 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:27:20.544496 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:27:20.544497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:27:20.544517 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:27:20.544631 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:27:20.544836 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.545629 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.546846 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:27:20.547206 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:27:20.547280 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:27:20.547507 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:27:20.547669 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:27:20.547761 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 14:27:20.548025 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 14:27:20.548045 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:27:20.550390 1304 raft_consensus.cc:1261] T be086c3edd0d40bd80c515b35aa4a542 P 1fe559d58a624c47a250c3e70a5b5d0a [term 1 FOLLOWER]: Refusing update from remote peer 2d6fa2237f5b4b08a78f4ac183ce309f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:27:20.550772 1617 raft_consensus.cc:1261] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6fa2237f5b4b08a78f4ac183ce309f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:27:20.551282 1696 consensus_queue.cc:1035] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c9b1f683bf9496081a65fc2e28190c8" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:27:20.551708 1696 consensus_queue.cc:1035] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fe559d58a624c47a250c3e70a5b5d0a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:27:20.555949 1705 mvcc.cc:205] Tried to move back new op lower bound from 7317333772491116544 to 7317333772425240576. Current Snapshot: MvccSnapshot[applied={T|T < 7317333772491116544}]
I20260811 14:27:20.556975 1124 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:27:20.557068 1124 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:27:20.557749 1707 mvcc.cc:205] Tried to move back new op lower bound from 7317333772491116544 to 7317333772425240576. Current Snapshot: MvccSnapshot[applied={T|T < 7317333772491116544}]
I20260811 14:27:20.558089 1124 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cef2f934c5ce430f9e61bc0166c7c828: Sending DeleteTablet for 3 replicas of tablet be086c3edd0d40bd80c515b35aa4a542
I20260811 14:27:20.558502 1596 tablet_service.cc:1514] Processing DeleteTablet for tablet be086c3edd0d40bd80c515b35aa4a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:27:20 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:59380
I20260811 14:27:20.559070 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet be086c3edd0d40bd80c515b35aa4a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:27:20 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:54484
I20260811 14:27:20.559645 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 1215
I20260811 14:27:20.559664 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet be086c3edd0d40bd80c515b35aa4a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:27:20 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:32798
I20260811 14:27:20.564448 1713 tablet_replica.cc:330] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: stopping tablet replica
I20260811 14:27:20.564548 1713 raft_consensus.cc:2229] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:27:20.564651 1713 raft_consensus.cc:2258] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:27:20.565006 1715 tablet_replica.cc:330] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: stopping tablet replica
I20260811 14:27:20.565089 1715 raft_consensus.cc:2229] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:27:20.565263 1715 raft_consensus.cc:2258] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:27:20.566000 1715 ts_tablet_manager.cc:1905] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:27:20.576265 1715 ts_tablet_manager.cc:1918] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:27:20.576342 1715 log.cc:1196] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/be086c3edd0d40bd80c515b35aa4a542
I20260811 14:27:20.576614 1715 ts_tablet_manager.cc:1939] T be086c3edd0d40bd80c515b35aa4a542 P 2d6fa2237f5b4b08a78f4ac183ce309f: Deleting consensus metadata
I20260811 14:27:20.577066 1108 catalog_manager.cc:4841] TS 2d6fa2237f5b4b08a78f4ac183ce309f (127.20.132.194:44279): tablet be086c3edd0d40bd80c515b35aa4a542 (table test-table [id=568596c6aabd4924b6c7bace1d4a7d00]) successfully deleted
I20260811 14:27:20.578938 1713 ts_tablet_manager.cc:1905] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:27:20.581998 1713 ts_tablet_manager.cc:1918] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:27:20.582085 1713 log.cc:1196] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/be086c3edd0d40bd80c515b35aa4a542
I20260811 14:27:20.582800 1713 ts_tablet_manager.cc:1939] T be086c3edd0d40bd80c515b35aa4a542 P 3c9b1f683bf9496081a65fc2e28190c8: Deleting consensus metadata
I20260811 14:27:20.583252 1106 catalog_manager.cc:4841] TS 3c9b1f683bf9496081a65fc2e28190c8 (127.20.132.195:43771): tablet be086c3edd0d40bd80c515b35aa4a542 (table test-table [id=568596c6aabd4924b6c7bace1d4a7d00]) successfully deleted
W20260811 14:27:20.591471 1108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:44015 (error 108)
I20260811 14:27:20.592410 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 1364
I20260811 14:27:20.595144 1684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:27:20.594987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44015 (local address 127.0.0.1:32800)
0811 14:27:20.595054 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 14:27:20.595101 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 14:27:20.600515 1108 catalog_manager.cc:4584] TS 1fe559d58a624c47a250c3e70a5b5d0a (127.20.132.193:44015): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet be086c3edd0d40bd80c515b35aa4a542: Network error: Client connection negotiation failed: client connection to 127.20.132.193:44015: connect: Connection refused (error 111)
I20260811 14:27:20.601356 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 1519
I20260811 14:27:20.608762 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 1089
I20260811 14:27:20.618975 21011 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 14:27:20.963114 21011 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 14:27:20.963245 21011 mini_ranger.cc:66] Stopping Ranger...
I20260811 14:27:21.318325 21011 mini_ranger.cc:68] Stopped Ranger
2026-08-11 14:27:21.318 UTC [632] LOG: received smart shutdown request
2026-08-11 14:27:21.323 UTC [632] LOG: background worker "logical replication launcher" (PID 641) exited with exit code 1
2026-08-11 14:27:21.323 UTC [636] LOG: shutting down
2026-08-11 14:27:21.485 UTC [632] LOG: database system is shut down
2026-08-11T14:27:21Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48189 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:27:21 dist-test-slave-cbbz krb5kdc[1726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:27:21 dist-test-slave-cbbz krb5kdc[1726](info): set up 2 sockets
Aug 11 14:27:21 dist-test-slave-cbbz krb5kdc[1726](info): commencing operation
krb5kdc: starting...
W20260811 14:27:22.715610 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:27:22 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:27:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:27:22Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/rangeradmin_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/rangeradmin_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/rangerlookup_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/rangerlookup_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
I20260811 14:27:22.876066 21011 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task2EBArE/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/postgres -l logfile start
2026-08-11 14:27:25.392 UTC [1762] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 14:27:25.392 UTC [1762] LOG: listening on IPv4 address "127.20.132.212", port 33247
2026-08-11 14:27:25.396 UTC [1762] LOG: listening on Unix socket "/tmp/.s.PGSQL.33247"
2026-08-11 14:27:25.418 UTC [1765] LOG: database system was shut down at 2026-08-11 14:27:23 UTC
2026-08-11 14:27:25.421 UTC [1762] LOG: database system is ready to accept connections
I20260811 14:27:26.457008 21011 mini_postgres.cc:96] Postgres bound to 33247
2026-08-11 14:27:26.464 UTC [1773] FATAL: database "slave" does not exist
127.20.132.212:33247 - accepting connections
I20260811 14:27:26.464572 21011 mini_ranger.cc:161] Starting Ranger...
I20260811 14:27:26.479293 21011 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 14:27:26.959967 21011 mini_ranger.cc:87] Created ranger Postgres database
I20260811 14:27:26.960060 21011 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-admin
2026-08-11 14:27:27,244 [I] DB FLAVOR :POSTGRES
2026-08-11 14:27:27,245 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 14:27:27,245 [I] Checking connection..
2026-08-11 14:27:27,245 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 14:27:27,519 [I] Checking connection passed.
2026-08-11 14:27:27,519 [I] --------- Verifying version history table ---------
2026-08-11 14:27:27,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:27:27,799 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 14:27:27,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:27:28,051 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 14:27:28,051 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 14:27:28,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 14:27:28.297 UTC [1850] WARNING: there is no transaction in progress
2026-08-11 14:27:28,305 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 14:27:28,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:27:28,563 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 14:27:28,563 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 14:27:28,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 14:27:28,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 14:27:29,074 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-cbbz.c.gcp-upstream.internal','N') ;"
2026-08-11 14:27:29,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 14:27:29,584 [I] Table x_portal_user does not exist in database ranger
2026-08-11 14:27:29,584 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 14:27:29,837 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 14:27:29,838 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 14:27:30,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 14:27:30,330 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 14:27:30,331 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 14:27:31.270 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.286 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.301 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.316 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.334 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.355 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.412 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.419 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.432 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.442 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.452 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.465 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.474 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.480 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.486 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:31.493 UTC [1976] WARNING: there is no transaction in progress
2026-08-11 14:27:32,105 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 14:27:32,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 14:27:32,361 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 14:27:32,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 14:27:32,632 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 14:27:32,632 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 14:27:32,900 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 14:27:32,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 14:27:33,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 14:27:33,436 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-cbbz.c.gcp-upstream.internal';"
2026-08-11 14:27:33,692 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 14:27:33,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 14:27:33,942 [I] DB_PATCHES have already been applied
I20260811 14:27:33.948118 21011 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-admin:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task2EBArE/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 14:27:33.948248 21011 mini_ranger.cc:193] Using host: 127.20.132.212
I20260811 14:27:33.951872 21011 mini_ranger.cc:227] Ranger admin URL: http://127.20.132.212:35945
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 2:27:34 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 14:27:35.220679 21011 mini_ranger.cc:160] Time spent starting Ranger: real 8.756s user 0.001s sys 0.009s
Aug 11, 2026 2:27:55 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 2:27:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 2:27:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 2:27:56 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 2:27:57 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 14:27:57.677629 21011 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.132.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.132.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/rangerkms_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.132.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/rangerkms_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.132.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.132.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.132.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/HTTP_127.20.132.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 14:27:57 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458477, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 14:27:57.769362 21011 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 14:27:57.778716 21011 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 14:27:58.609611 21011 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 14:27:58.609712 21011 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms
I20260811 14:27:58.609740 21011 mini_ranger_kms.cc:227] Using postgres at 127.20.132.212:33247
2026-08-11 14:27:58,799 [I] DB FLAVOR :POSTGRES
2026-08-11 14:27:58,800 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 14:27:58,800 [I] Checking connection
2026-08-11 14:27:58,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 14:27:59,038 [I] connection success
2026-08-11 14:27:59,039 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 14:27:59,039 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 14:27:59,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 14:27:59,275 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 14:27:59,276 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 14:27:59,276 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 14:27:59,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.132.212:33247/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 14:27:59,527 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 14:27:59.995182 21011 mini_ranger_kms.cc:310] Created kms service
I20260811 14:28:00.178383 21011 mini_ranger_kms.cc:326] Created kudu user
I20260811 14:28:00.220041 21011 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 14:28:00 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458477, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:00.630839 21011 mini_ranger_kms.cc:384] Added ranger policy
I20260811 14:28:00.631067 21011 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms:/tmp/dist-test-task2EBArE/build/release/bin/postgresql.jar:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task2EBArE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 14:28:00.631100 21011 mini_ranger_kms.cc:240] Using host: 127.20.132.212
I20260811 14:28:00.635438 21011 mini_ranger_kms.cc:276] Ranger KMS PID: 2185
I20260811 14:28:00.635519 21011 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.132.212:43613
Aug 11, 2026 2:28:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:28:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:28:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 2:28:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 2:28:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 2:28:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 14:28:02 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786458482, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.132.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:03.060271 21011 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.291s user 0.012s sys 0.162s
I20260811 14:28:03.060375 21011 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 14:28:03.060421 21011 mini_ranger_kms.cc:401] 127.20.132.212:43613/kms/v1/keys
Aug 11 14:28:03 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458482, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.132.212@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
Aug 11 14:28:03 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458482, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.132.212@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
Aug 11 14:28:06 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:28:06.058954 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:43293
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:43293
--ranger_config_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:06.141330 2242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:06.141537 2242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:06.141559 2242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:06.142683 2242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:06.142717 2242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:06.142732 2242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:06.142745 2242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:06.142756 2242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:06.144341 2242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.132.212:43613/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:43293
--ranger_config_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:43293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:06.144528 2242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:06.144692 2242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:06.149575 2253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:06.149529 2249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:06.149570 2242 server_base.cc:1034] running on GCE node
W20260811 14:28:06.149533 2250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:06.149991 2242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:06.150278 2242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:06.151417 2242 hybrid_clock.cc:648] HybridClock initialized: now 1786458486151393 us; error 39 us; skew 500 ppm
Aug 11 14:28:06 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458486, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:06.153923 2242 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:06.154364 2242 webserver.cc:460] Webserver started at http://127.20.132.254:41139/ using document root <none> and password file <none>
I20260811 14:28:06.154587 2242 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:06.154627 2242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:06.154799 2242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:28:06 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458486, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:06.218142 2242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "2c6a5e71b06140f99cb24a16614079a1"
format_stamp: "Formatted at 2026-08-11 14:28:06 on dist-test-slave-cbbz"
server_key: "8191ee1dcc34b7c827cf55b2f2d0557c"
server_key_iv: "e7dbb35a920f8fe6ab3853cc3fb0314b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:06.218582 2242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "2c6a5e71b06140f99cb24a16614079a1"
format_stamp: "Formatted at 2026-08-11 14:28:06 on dist-test-slave-cbbz"
server_key: "8191ee1dcc34b7c827cf55b2f2d0557c"
server_key_iv: "e7dbb35a920f8fe6ab3853cc3fb0314b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:06.220048 2242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 14:28:06.236114 2261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:06.236379 2242 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:06.236509 2242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "2c6a5e71b06140f99cb24a16614079a1"
format_stamp: "Formatted at 2026-08-11 14:28:06 on dist-test-slave-cbbz"
server_key: "8191ee1dcc34b7c827cf55b2f2d0557c"
server_key_iv: "e7dbb35a920f8fe6ab3853cc3fb0314b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:06.236618 2242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:06.249720 2242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:06.251650 2242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:06.251828 2242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:06.257023 2242 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:43293
I20260811 14:28:06.257050 2318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:43293 every 8 connection(s)
I20260811 14:28:06.257493 2242 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:06.258180 2319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:06.260576 2319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Bootstrap starting.
I20260811 14:28:06.261186 2319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:06.261487 2319 log.cc:824] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:06.262195 2319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: No bootstrap required, opened a new log
I20260811 14:28:06.264297 2319 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:06.264441 2319 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:06.264463 2319 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c6a5e71b06140f99cb24a16614079a1, State: Initialized, Role: FOLLOWER
I20260811 14:28:06.264627 2319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:06.264706 2319 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:06.264729 2319 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:06.264796 2319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:06.265336 2319 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:06.265476 2319 leader_election.cc:302] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c6a5e71b06140f99cb24a16614079a1; no voters:
I20260811 14:28:06.265491 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 2242
I20260811 14:28:06.265595 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:28:06.265668 2319 leader_election.cc:288] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:28:06.265714 2323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:06.265800 21011 external_mini_cluster.cc:1428] Setting key abbbc437e61e9de20de57f98d8fa7f56
I20260811 14:28:06.265911 2323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c6a5e71b06140f99cb24a16614079a1, State: Running, Role: LEADER
I20260811 14:28:06.266024 2319 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:06.266422 2323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:06.266773 2323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c6a5e71b06140f99cb24a16614079a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } } }
I20260811 14:28:06.266929 2323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:06.267109 2323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c6a5e71b06140f99cb24a16614079a1. Latest consensus state: current_term: 1 leader_uuid: "2c6a5e71b06140f99cb24a16614079a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } } }
I20260811 14:28:06.267256 2323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:06.267295 2335 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:06.267596 2319 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 14:28:06.267851 2335 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 14:28:06 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:06.283699 2328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:06.266300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36202 (local address 127.20.132.254:43293)
0811 14:28:06.270609 (+ 4309us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:06.270624 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:06.270703 (+ 79us) server_negotiation.cc:407] Connection header received
0811 14:28:06.271519 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:06.271532 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:06.271619 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:06.271801 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:06.272951 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:06.274448 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:06.275549 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:06.276250 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:06.276355 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:06.279406 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:06.279410 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:06.279410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:06.279423 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:06.281549 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:06.281989 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:06.281992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:06.281992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:06.282100 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:06.282308 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:06.282309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:06.282309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:06.282635 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:06.282779 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:06.283312 (+ 533us) server_negotiation.cc:299] Negotiation successful
0811 14:28:06.283444 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4167,"thread_start_us":104,"threads_started":1}
I20260811 14:28:06.288925 2335 catalog_manager.cc:1347] Generated new cluster ID: f5d3738ef92e473d9e6bd31e3c13b48e
I20260811 14:28:06.288982 2335 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:06.319561 2335 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:28:06.320456 2335 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:06.333606 2335 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Generated new TSK 0
I20260811 14:28:06.333956 2335 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:28:07.015472 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:43293
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:07.103374 2368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:07.103572 2368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:07.103595 2368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:07.104791 2368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:07.104832 2368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:07.104858 2368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:07.106348 2368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.132.212:43613/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:43293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:07.106609 2368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:07.106844 2368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:07.111764 2377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.111915 2374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.112100 2379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:07.112390 2368 server_base.cc:1034] running on GCE node
I20260811 14:28:07.112610 2368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:07.112851 2368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:07.114027 2368 hybrid_clock.cc:648] HybridClock initialized: now 1786458487114005 us; error 41 us; skew 500 ppm
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:07.116909 2368 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:07.117452 2368 webserver.cc:460] Webserver started at http://127.20.132.193:46369/ using document root <none> and password file <none>
I20260811 14:28:07.117727 2368 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:07.117798 2368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:07.117933 2368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:07.131999 2368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "9aa1843800e348c7bedec980f9c0597c"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "247a0fc0a1fa355980aef8ec13997e83"
server_key_iv: "baebd7392ddb432ef13a27315a5440b3"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.132581 2368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "9aa1843800e348c7bedec980f9c0597c"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "247a0fc0a1fa355980aef8ec13997e83"
server_key_iv: "baebd7392ddb432ef13a27315a5440b3"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.134397 2368 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:28:07.147264 2386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.147476 2368 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:07.147584 2368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "9aa1843800e348c7bedec980f9c0597c"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "247a0fc0a1fa355980aef8ec13997e83"
server_key_iv: "baebd7392ddb432ef13a27315a5440b3"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.147670 2368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:07.168673 2368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:07.171100 2368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:07.171260 2368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:07.171538 2368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:07.171972 2368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:07.172052 2368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.172102 2368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:07.172161 2368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.179503 2368 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:45243
I20260811 14:28:07.179903 2509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:45243 every 8 connection(s)
I20260811 14:28:07.180002 2368 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:28:07.181962 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 2368
I20260811 14:28:07.182078 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:28:07.182277 21011 external_mini_cluster.cc:1428] Setting key 0e5025ea8bd01f73aa84d2c639b354a9
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:07.201412 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:07.181298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43293 (local address 127.20.132.193:48265)
0811 14:28:07.184301 (+ 3003us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:07.184350 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:07.184982 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:07.191449 (+ 6467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:07.191456 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:07.191749 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:07.192060 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:07.192066 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.193020 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.193021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:07.194140 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:07.194143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.194679 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.194680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:07.194829 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:07.195451 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:07.195461 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:07.197193 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:07.199453 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:07.199460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:07.199462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:07.199790 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:07.200038 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:07.200039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:07.200040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:07.200223 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:07.200554 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:07.200561 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:07.200762 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 14:28:07.200906 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 14:28:07.201096 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2955,"thread_start_us":88,"threads_started":1}
I20260811 14:28:07.201930 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:07.181307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:48265 (local address 127.20.132.254:43293)
0811 14:28:07.181466 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:07.181468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:07.185126 (+ 3658us) server_negotiation.cc:407] Connection header received
0811 14:28:07.185155 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:07.185156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:07.185170 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:07.185240 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:07.192225 (+ 6985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.192884 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.194248 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.194523 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.194590 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:07.197315 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:07.197317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:07.197318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:07.197328 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:07.199357 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:07.199895 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:07.199896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:07.199896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:07.199965 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:07.200317 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:07.200318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:07.200318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:07.200466 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:07.200528 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:07.201686 (+ 1158us) server_negotiation.cc:299] Negotiation successful
0811 14:28:07.201786 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260811 14:28:07.202492 2510 heartbeater.cc:347] Connected to a master server at 127.20.132.254:43293
I20260811 14:28:07.202589 2510 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:07.202797 2510 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:07.203382 2280 ts_manager.cc:194] Registered new tserver with Master: 9aa1843800e348c7bedec980f9c0597c (127.20.132.193:45243)
I20260811 14:28:07.204344 2280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:48265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:28:07.217636 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:43293
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:07.326753 2518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:07.327032 2518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:07.327077 2518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:07.328769 2518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:07.328831 2518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:07.328871 2518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:07.331061 2518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.132.212:43613/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:43293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:07.331338 2518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:07.331602 2518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:07.337885 2528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.337894 2525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.338296 2526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:07.338801 2518 server_base.cc:1034] running on GCE node
I20260811 14:28:07.339010 2518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:07.339301 2518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:07.340458 2518 hybrid_clock.cc:648] HybridClock initialized: now 1786458487340437 us; error 37 us; skew 500 ppm
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:07.343638 2518 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:07.344167 2518 webserver.cc:460] Webserver started at http://127.20.132.194:45575/ using document root <none> and password file <none>
I20260811 14:28:07.344452 2518 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:07.344511 2518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:07.344687 2518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:07.367266 2518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "2ec92e75363646c387d5c687a16fd01d"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "9eb27410a4f6c9fe76b2becb94045fec"
server_key_iv: "f0b1553599222148cd6d17051be6ee7b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.367759 2518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "2ec92e75363646c387d5c687a16fd01d"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "9eb27410a4f6c9fe76b2becb94045fec"
server_key_iv: "f0b1553599222148cd6d17051be6ee7b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.369510 2518 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:07.388258 2535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.388558 2518 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 14:28:07.388737 2518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "2ec92e75363646c387d5c687a16fd01d"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "9eb27410a4f6c9fe76b2becb94045fec"
server_key_iv: "f0b1553599222148cd6d17051be6ee7b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.388906 2518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:07.413519 2518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:07.416172 2518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:07.416379 2518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:07.416707 2518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:07.417168 2518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:07.417259 2518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.417323 2518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:07.417368 2518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.424279 2518 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:32875
I20260811 14:28:07.424786 2518 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:07.427848 2665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:32875 every 8 connection(s)
I20260811 14:28:07.432626 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 2518
I20260811 14:28:07.432726 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:28:07.432920 21011 external_mini_cluster.cc:1428] Setting key b4985e3a8edce3d45c9894e1be2e75c6
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:07.440121 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:07.428706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:51777 (local address 127.20.132.254:43293)
0811 14:28:07.428757 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:07.428759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:07.429019 (+ 260us) server_negotiation.cc:407] Connection header received
0811 14:28:07.429709 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:07.429710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:07.429726 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:07.429788 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:07.430573 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.431379 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.433621 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.433943 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.433988 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:07.436710 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:07.436711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:07.436711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:07.436720 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:07.438469 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:07.438982 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:07.438983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:07.438983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:07.439044 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:07.439342 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:07.439343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:07.439343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:07.439482 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:07.439529 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:07.439926 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 14:28:07.440025 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:28:07.440893 2668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:07.428673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43293 (local address 127.20.132.194:51777)
0811 14:28:07.428853 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:07.428901 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:07.429589 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:07.429878 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:07.429882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:07.430152 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:07.430451 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:07.430457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.431493 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.431494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:07.433508 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:07.433511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.434095 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.434096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:07.434239 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:07.434845 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:07.434855 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:07.436598 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:07.438578 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:07.438584 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:07.438587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:07.438882 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:07.439126 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:07.439126 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:07.439127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:07.439258 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:07.439596 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:07.439603 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:07.439760 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 14:28:07.440485 (+ 725us) client_negotiation.cc:240] Negotiation successful
0811 14:28:07.440663 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260811 14:28:07.441578 2666 heartbeater.cc:347] Connected to a master server at 127.20.132.254:43293
I20260811 14:28:07.441674 2666 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:07.441887 2666 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:07.442303 2280 ts_manager.cc:194] Registered new tserver with Master: 2ec92e75363646c387d5c687a16fd01d (127.20.132.194:32875)
I20260811 14:28:07.442703 2280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:51777
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:28:07.475291 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:43293
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:07.593005 2672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:07.593358 2672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:07.593439 2672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:07.595217 2672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:07.595319 2672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:07.595391 2672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:07.597549 2672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.132.212:43613/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:43293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:07.597962 2672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:07.598295 2672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:07.605005 2682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:07.605494 2672 server_base.cc:1034] running on GCE node
W20260811 14:28:07.606329 2679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.606542 2680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:07.606998 2672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:07.607295 2672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:07.608448 2672 hybrid_clock.cc:648] HybridClock initialized: now 1786458487608421 us; error 40 us; skew 500 ppm
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:07.611972 2672 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:07.612587 2672 webserver.cc:460] Webserver started at http://127.20.132.195:42803/ using document root <none> and password file <none>
I20260811 14:28:07.612835 2672 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:07.612885 2672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:07.616374 2672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:07.641083 2672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "43dee926b38549ff873490c39581084b"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "efef9303996ee326b808e7beaf2a6f6f"
server_key_iv: "85ef2bd18940dc9062bf7d603de3db5e"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.641620 2672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "43dee926b38549ff873490c39581084b"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "efef9303996ee326b808e7beaf2a6f6f"
server_key_iv: "85ef2bd18940dc9062bf7d603de3db5e"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.646248 2672 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 14:28:07.667801 2690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.668081 2672 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260811 14:28:07.668207 2672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "43dee926b38549ff873490c39581084b"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "efef9303996ee326b808e7beaf2a6f6f"
server_key_iv: "85ef2bd18940dc9062bf7d603de3db5e"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:07.668298 2672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:07.680925 2672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:07.683349 2672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:07.683525 2672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:07.683786 2672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:07.684192 2672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:07.684248 2672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.684302 2672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:07.684327 2672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:07.691339 2672 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43259
I20260811 14:28:07.691789 2672 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:28:07.694229 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 2672
I20260811 14:28:07.694373 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:28:07.694558 21011 external_mini_cluster.cc:1428] Setting key c5c5b929b344c90c9222cd9485004545
I20260811 14:28:07.695700 2813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43259 every 8 connection(s)
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:07.707069 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:07.696216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:43427 (local address 127.20.132.254:43293)
0811 14:28:07.696308 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:07.696310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:07.697026 (+ 716us) server_negotiation.cc:407] Connection header received
0811 14:28:07.697716 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:07.697717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:07.697730 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:07.697762 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:07.698554 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.699326 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.700761 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.701061 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.701162 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:07.703737 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:07.703739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:07.703740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:07.703749 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:07.705451 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:07.705959 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:07.705960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:07.705961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:07.706026 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:07.706333 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:07.706334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:07.706334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:07.706489 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:07.706562 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:07.706894 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 14:28:07.706982 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 14:28:07.707234 2816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:07.695882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43293 (local address 127.20.132.195:43427)
0811 14:28:07.696888 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:07.696938 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:07.697581 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:07.697945 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:07.697950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:07.698185 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:07.698446 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:07.698452 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.699442 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.699443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:07.700653 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:07.700656 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:07.701214 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:07.701215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:07.701346 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:07.701981 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:07.701990 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:07.703632 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:07.705552 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:07.705560 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:07.705562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:07.705867 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:07.706111 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:07.706112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:07.706112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:07.706253 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:07.706570 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:07.706577 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:07.706733 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 14:28:07.706849 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 14:28:07.707001 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":963,"thread_start_us":88,"threads_started":1}
I20260811 14:28:07.707815 2814 heartbeater.cc:347] Connected to a master server at 127.20.132.254:43293
I20260811 14:28:07.707916 2814 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:07.708106 2814 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:07.708523 2280 ts_manager.cc:194] Registered new tserver with Master: 43dee926b38549ff873490c39581084b (127.20.132.195:43259)
I20260811 14:28:07.708956 2280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:43427
I20260811 14:28:07.711971 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:28:07.712682 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 2368
I20260811 14:28:07.719360 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 2518
I20260811 14:28:07.736609 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 2672
I20260811 14:28:07.750978 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 2242
I20260811 14:28:07.764773 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:43293
--webserver_interface=127.20.132.254
--webserver_port=41139
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:43293
--ranger_config_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:07.849056 2817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:07.849294 2817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:07.849334 2817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:07.850561 2817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:07.850641 2817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:07.850664 2817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:07.850693 2817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:07.850725 2817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:07.852494 2817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:43293
--ranger_config_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:43293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=41139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:07.852787 2817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:07.853024 2817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:07.858786 2825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.858768 2823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:07.858765 2822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:07.859066 2817 server_base.cc:1034] running on GCE node
I20260811 14:28:07.859318 2817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:07.859637 2817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:07.860811 2817 hybrid_clock.cc:648] HybridClock initialized: now 1786458487860798 us; error 29 us; skew 500 ppm
Aug 11 14:28:07 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:07.863747 2817 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:07.864235 2817 webserver.cc:460] Webserver started at http://127.20.132.254:41139/ using document root <none> and password file <none>
I20260811 14:28:07.864476 2817 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:07.864552 2817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 14:28:08 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:08.710853 2817 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:08.711761 2836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:08.711920 2817 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:08.712013 2817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "2c6a5e71b06140f99cb24a16614079a1"
format_stamp: "Formatted at 2026-08-11 14:28:06 on dist-test-slave-cbbz"
server_key: "8191ee1dcc34b7c827cf55b2f2d0557c"
server_key_iv: "e7dbb35a920f8fe6ab3853cc3fb0314b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:08.712441 2817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:08.728519 2817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:08.730504 2817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:08.730607 2817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:08.735204 2817 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:43293
I20260811 14:28:08.735244 2892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:43293 every 8 connection(s)
I20260811 14:28:08.735610 2817 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:08.736825 2893 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:28:08.737501 2893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Bootstrap starting.
I20260811 14:28:08.744853 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 2817
I20260811 14:28:08.745155 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:45243
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:43293
--webserver_port=46369
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:08.745793 2893 log.cc:824] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:08.747956 2893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:08.748306 2893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Bootstrap complete.
I20260811 14:28:08.750748 2893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:08.751004 2893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c6a5e71b06140f99cb24a16614079a1, State: Initialized, Role: FOLLOWER
I20260811 14:28:08.751199 2893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:08.751292 2893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:08.751346 2893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:08.751395 2893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:28:08.752496 2893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:08.752615 2893 leader_election.cc:302] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c6a5e71b06140f99cb24a16614079a1; no voters:
I20260811 14:28:08.752801 2893 leader_election.cc:288] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 14:28:08.752876 2897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:28:08.753062 2893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:08.753099 2897 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [term 2 LEADER]: Becoming Leader. State: Replica: 2c6a5e71b06140f99cb24a16614079a1, State: Running, Role: LEADER
I20260811 14:28:08.753325 2897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } }
I20260811 14:28:08.753654 2898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2c6a5e71b06140f99cb24a16614079a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } } }
I20260811 14:28:08.753671 2899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c6a5e71b06140f99cb24a16614079a1. Latest consensus state: current_term: 2 leader_uuid: "2c6a5e71b06140f99cb24a16614079a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6a5e71b06140f99cb24a16614079a1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 43293 } } }
I20260811 14:28:08.753739 2898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:08.753777 2899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:08.754061 2908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:08.754611 2908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:08.754873 2908 catalog_manager.cc:1259] Loaded cluster ID: f5d3738ef92e473d9e6bd31e3c13b48e
I20260811 14:28:08.754956 2893 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 14:28:08.754966 2908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:08.759964 2908 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:08.760459 2908 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Loaded TSK: 0
I20260811 14:28:08.760706 2908 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:28:08.862457 2896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:08.862736 2896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:08.862772 2896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:08.864472 2896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:08.864532 2896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:08.864571 2896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:08.866835 2896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:45243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=46369
--tserver_master_addrs=127.20.132.254:43293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:08.867074 2896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:08.867331 2896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:08.873992 2936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:08.874289 2939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:08.874264 2937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:08.874130 2896 server_base.cc:1034] running on GCE node
I20260811 14:28:08.874670 2896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:08.875027 2896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:08.876219 2896 hybrid_clock.cc:648] HybridClock initialized: now 1786458488876197 us; error 39 us; skew 500 ppm
Aug 11 14:28:08 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458488, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:08.880350 2896 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:08.880932 2896 webserver.cc:460] Webserver started at http://127.20.132.193:46369/ using document root <none> and password file <none>
I20260811 14:28:08.881201 2896 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:08.881289 2896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 14:28:08 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458488, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:08.906490 2896 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:08.907799 2947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:08.908098 2896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:08.908257 2896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "9aa1843800e348c7bedec980f9c0597c"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "247a0fc0a1fa355980aef8ec13997e83"
server_key_iv: "baebd7392ddb432ef13a27315a5440b3"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:08.908790 2896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:08.937086 2896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:08.939567 2896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:08.939739 2896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:08.940007 2896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:08.940460 2896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:08.940511 2896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:08.940553 2896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:08.940578 2896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:08.947129 2896 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:45243
I20260811 14:28:08.947593 2896 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:28:08.949106 3073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:45243 every 8 connection(s)
Aug 11 14:28:08 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458488, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:08.957170 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 2896
I20260811 14:28:08.957494 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:32875
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:43293
--webserver_port=45575
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:08.961026 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:08.949815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43293 (local address 127.20.132.193:48093)
0811 14:28:08.950015 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:08.950084 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:08.950717 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:08.951192 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:08.951196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:08.951436 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:08.951727 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:08.951734 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:08.952899 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:08.952900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:08.954018 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:08.954020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:08.954938 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:08.954939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:08.955069 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:08.955668 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:08.955682 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:08.957027 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:08.959049 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:08.959057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:08.959059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:08.959391 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:08.959694 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:08.959695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:08.959695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:08.959825 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:08.960338 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:08.960345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:08.960501 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 14:28:08.960589 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 14:28:08.960757 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260811 14:28:08.961787 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:08.950013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:48093 (local address 127.20.132.254:43293)
0811 14:28:08.950232 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:08.950241 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:08.950279 (+ 38us) server_negotiation.cc:407] Connection header received
0811 14:28:08.950940 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:08.950946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:08.950989 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:08.951099 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:08.951838 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:08.952789 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:08.954141 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:08.954805 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:08.954930 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:08.957162 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:08.957166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:08.957166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:08.957191 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:08.958934 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:08.959497 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:08.959500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:08.959501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:08.959616 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:08.959905 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:08.959905 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:08.959906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:08.960245 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:08.961345 (+ 1100us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:08.961417 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 14:28:08.961538 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":119,"threads_started":1}
I20260811 14:28:08.962484 3074 heartbeater.cc:347] Connected to a master server at 127.20.132.254:43293
I20260811 14:28:08.962595 3074 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:08.962795 3074 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
W20260811 14:28:08.963639 3074 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:43293 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 14:28:08.963725 3074 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:08.963795 3074 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:08.964128 3074 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:08.964222 3074 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
W20260811 14:28:08.964529 3074 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:28:09.079281 3079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:09.079586 3079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:09.079623 3079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:09.081378 3079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:09.081437 3079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:09.081478 3079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:09.083663 3079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:32875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=45575
--tserver_master_addrs=127.20.132.254:43293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:09.083940 3079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:09.084234 3079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:09.090595 3085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:09.090678 3084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:09.090930 3087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:09.091017 3079 server_base.cc:1034] running on GCE node
I20260811 14:28:09.091370 3079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:09.091665 3079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:09.092842 3079 hybrid_clock.cc:648] HybridClock initialized: now 1786458489092838 us; error 36 us; skew 500 ppm
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:09.095512 3079 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:09.096001 3079 webserver.cc:460] Webserver started at http://127.20.132.194:45575/ using document root <none> and password file <none>
I20260811 14:28:09.096308 3079 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:09.096395 3079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:09.110419 3079 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:09.111539 3096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:09.111764 3079 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:09.111860 3079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "2ec92e75363646c387d5c687a16fd01d"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "9eb27410a4f6c9fe76b2becb94045fec"
server_key_iv: "f0b1553599222148cd6d17051be6ee7b"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:09.112344 3079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:09.126428 3079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:09.128561 3079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:09.128733 3079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:09.128981 3079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:09.129347 3079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:09.129384 3079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:09.129406 3079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:09.129419 3079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:09.137075 3079 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:32875
I20260811 14:28:09.137485 3079 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:09.138000 3221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:32875 every 8 connection(s)
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:09.146597 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3079
I20260811 14:28:09.146948 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.132.212:43613/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:43259
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:43293
--webserver_port=42803
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:09.148496 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:09.138582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:37457 (local address 127.20.132.254:43293)
0811 14:28:09.138640 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:09.138643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:09.138658 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:28:09.139108 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:09.139109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:09.139125 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:09.139190 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:09.139817 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.140418 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.141926 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.142237 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.142286 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:09.144961 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:09.144963 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:09.144964 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:09.144971 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:09.146736 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:09.147278 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:09.147279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:09.147279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:09.147345 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:09.147667 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:09.147668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:09.147669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:09.147827 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:09.147903 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:09.148296 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 14:28:09.148394 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 14:28:09.148720 3225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:09.138263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43293 (local address 127.20.132.194:37457)
0811 14:28:09.138447 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:09.138488 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:09.138987 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:09.139263 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:09.139267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:09.139482 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:09.139721 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:09.139727 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.140541 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.140542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:09.141811 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:09.141814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.142411 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.142412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:09.142547 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:09.143139 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:09.143156 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:09.144850 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:09.146843 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:09.146852 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:09.146854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:09.147170 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:09.147428 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:09.147429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:09.147430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:09.147585 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:09.147904 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:09.147910 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:09.148077 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 14:28:09.148247 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 14:28:09.148420 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":114,"threads_started":1}
I20260811 14:28:09.149255 3222 heartbeater.cc:347] Connected to a master server at 127.20.132.254:43293
I20260811 14:28:09.149374 3222 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.149557 3222 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
W20260811 14:28:09.150195 3222 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:43293 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 14:28:09.150322 3222 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.150425 3222 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:09.150733 3222 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.150812 3222 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
W20260811 14:28:09.151085 3222 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:28:09.269724 3226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:09.269995 3226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:09.270033 3226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:09.271690 3226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:09.271747 3226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:09.271787 3226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:09.273904 3226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.132.212:43613/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:43259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=42803
--tserver_master_addrs=127.20.132.254:43293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:09.274158 3226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:09.274422 3226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:09.280709 3237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:09.282217 3235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:09.282294 3233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:09.283252 3226 server_base.cc:1034] running on GCE node
I20260811 14:28:09.283465 3226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:09.283738 3226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:09.284916 3226 hybrid_clock.cc:648] HybridClock initialized: now 1786458489284886 us; error 43 us; skew 500 ppm
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:09.288103 3226 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:09.288640 3226 webserver.cc:460] Webserver started at http://127.20.132.195:42803/ using document root <none> and password file <none>
I20260811 14:28:09.288920 3226 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:09.288995 3226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:09.310712 3226 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s
I20260811 14:28:09.312332 3245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:09.312580 3226 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 14:28:09.312698 3226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "43dee926b38549ff873490c39581084b"
format_stamp: "Formatted at 2026-08-11 14:28:07 on dist-test-slave-cbbz"
server_key: "efef9303996ee326b808e7beaf2a6f6f"
server_key_iv: "85ef2bd18940dc9062bf7d603de3db5e"
server_key_version: "kuduclusterkey@0"
I20260811 14:28:09.313165 3226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:09.337435 3226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:09.340297 3226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:09.340461 3226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:09.340731 3226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:09.341107 3226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:09.341157 3226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:09.341188 3226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:09.341214 3226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:09.348774 3226 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43259
I20260811 14:28:09.348871 3366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43259 every 8 connection(s)
I20260811 14:28:09.349182 3226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:28:09.354580 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3226
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:09.359805 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:09.350127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:39821 (local address 127.20.132.254:43293)
0811 14:28:09.350206 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:09.350208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:09.350390 (+ 182us) server_negotiation.cc:407] Connection header received
0811 14:28:09.350906 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:09.350908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:09.350921 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:09.350990 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:09.351541 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.352048 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.353297 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.353508 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.353619 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:09.356680 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:09.356682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:09.356682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:09.356689 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:09.358232 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:09.358728 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:09.358729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:09.358729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:09.358801 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:09.359083 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:09.359084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:09.359085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:09.359224 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:09.359285 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:09.359626 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 14:28:09.359709 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:28:09.360524 3372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:09.350094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:43293 (local address 127.20.132.195:39821)
0811 14:28:09.350276 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:09.350316 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:09.350792 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:09.351054 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:09.351059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:09.351257 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:09.351441 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:09.351446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.352179 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.352180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:09.353176 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:09.353179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.353653 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.353655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:09.353794 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:09.354363 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:09.354373 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:09.356562 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:09.358338 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:09.358345 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:09.358347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:09.358626 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:09.358866 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:09.358866 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:09.358867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:09.359001 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:09.359313 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:09.359321 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:09.359472 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 14:28:09.360105 (+ 633us) client_negotiation.cc:240] Negotiation successful
0811 14:28:09.360301 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260811 14:28:09.361344 3367 heartbeater.cc:347] Connected to a master server at 127.20.132.254:43293
I20260811 14:28:09.361456 3367 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.361660 3367 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
W20260811 14:28:09.362397 3367 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:43293 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 14:28:09.362454 3367 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.362525 3367 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:09.362897 3367 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.362986 3367 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
W20260811 14:28:09.363359 3367 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 14:28:09.366879 3374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:09.355178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55758 (local address 127.20.132.254:43293)
0811 14:28:09.355659 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:09.355662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:09.355669 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:28:09.355690 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:09.355691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:09.355703 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:09.355776 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:09.357573 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.358964 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.361145 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:09.361658 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:09.361814 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:09.364228 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:09.364229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:09.364229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:09.364236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:09.365749 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:09.366098 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:09.366099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:09.366100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:09.366159 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:09.366377 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:09.366378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:09.366378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:09.366485 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:09.366652 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:09.366690 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 14:28:09.366772 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":55,"threads_started":1}
Aug 11 14:28:09 dist-test-slave-cbbz krb5kdc[1726](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:09.964696 3074 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:09.964818 3074 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:09.965214 2854 ts_manager.cc:194] Registered new tserver with Master: 9aa1843800e348c7bedec980f9c0597c (127.20.132.193:45243)
I20260811 14:28:09.966220 2854 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:48093
I20260811 14:28:10.151311 3222 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:10.151479 3222 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:10.151811 2854 ts_manager.cc:194] Registered new tserver with Master: 2ec92e75363646c387d5c687a16fd01d (127.20.132.194:32875)
I20260811 14:28:10.152359 2854 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:37457
Aug 11 14:28:10 dist-test-slave-cbbz krb5kdc[1726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for HTTP/127.20.132.212@KRBTEST.COM
I20260811 14:28:10.363566 3367 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:10.363735 3367 heartbeater.cc:511] Master 127.20.132.254:43293 requested a full tablet report, sending...
I20260811 14:28:10.364015 2854 ts_manager.cc:194] Registered new tserver with Master: 43dee926b38549ff873490c39581084b (127.20.132.195:43259)
I20260811 14:28:10.364550 2854 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:39821
I20260811 14:28:10.368361 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:28:10.377149 3392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.369285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55772 (local address 127.20.132.254:43293)
0811 14:28:10.369590 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.369592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.369599 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:28:10.369620 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.369620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.369632 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.369688 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:10.370384 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.371115 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.372084 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.372405 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.372460 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.373894 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:10.373895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:10.373896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:10.373903 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:10.375636 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:10.376045 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:10.376046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:10.376046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:10.376105 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:10.376332 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:10.376332 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:10.376333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:10.376456 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:10.376545 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.376973 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.377054 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":71,"threads_started":1}
I20260811 14:28:10.379313 2854 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:28:10.381699 2854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:28:10.396690 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.390756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:32875 (local address 127.0.0.1:34158)
0811 14:28:10.391670 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:10.391710 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:10.391776 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:10.392067 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:10.392069 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:10.392071 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:10.392130 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.392159 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.393784 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.393785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.395026 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.395029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.396406 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.396407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.396486 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.396498 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 14:28:10.396561 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:28:10.396608 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"thread_start_us":343,"threads_started":1}
I20260811 14:28:10.396924 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.390944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34158 (local address 127.20.132.194:32875)
0811 14:28:10.391604 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.391609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.391852 (+ 243us) server_negotiation.cc:407] Connection header received
0811 14:28:10.391889 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.391891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.391908 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.391973 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:10.392263 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.393696 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.395121 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.396247 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.396319 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.396370 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.396812 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.396855 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":45,"threads_started":1}
I20260811 14:28:10.397641 3148 tablet_service.cc:1467] Processing CreateTablet for tablet 77084e6c314e4b4c8c29546897761710 (DEFAULT_TABLE table=test-table [id=8708e8f2639244d6ad25410f2e6d0448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:10.398029 3148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77084e6c314e4b4c8c29546897761710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:10.401552 3403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.391096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45243 (local address 127.0.0.1:46258)
0811 14:28:10.396342 (+ 5246us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:10.396349 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:10.396380 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:10.397634 (+ 1254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:10.397636 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:10.397638 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:10.397674 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.397676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.399273 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.399274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.400318 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.400321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.401334 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.401335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.401395 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.401399 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:10.401447 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 14:28:10.401485 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5234,"thread_start_us":106,"threads_started":1}
I20260811 14:28:10.402155 3404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.391197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46258 (local address 127.20.132.193:45243)
0811 14:28:10.397406 (+ 6209us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.397410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.397420 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:28:10.397454 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.397456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.397470 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.397544 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:10.397748 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.399154 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.400420 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.401159 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.401245 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.401298 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.402040 (+ 742us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.402080 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6174,"thread_start_us":54,"threads_started":1}
I20260811 14:28:10.402570 3405 tablet_bootstrap.cc:492] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Bootstrap starting.
I20260811 14:28:10.402829 2978 tablet_service.cc:1467] Processing CreateTablet for tablet 77084e6c314e4b4c8c29546897761710 (DEFAULT_TABLE table=test-table [id=8708e8f2639244d6ad25410f2e6d0448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:10.403149 2978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77084e6c314e4b4c8c29546897761710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:10.403235 3405 tablet_bootstrap.cc:654] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:10.403542 3405 log.cc:824] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:10.403796 3402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.390772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43259 (local address 127.0.0.1:55922)
0811 14:28:10.396206 (+ 5434us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:10.396217 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:10.396270 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:10.400191 (+ 3921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:10.400193 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:10.400195 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:10.400235 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.400237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.401507 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.401508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.402603 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.402606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.403587 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.403588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.403647 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.403651 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:10.403698 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 14:28:10.403731 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5415,"thread_start_us":164,"threads_started":1}
I20260811 14:28:10.404074 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.390862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55922 (local address 127.20.132.195:43259)
0811 14:28:10.397095 (+ 6233us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.397100 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.397111 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:28:10.397144 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.397146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.397161 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.397272 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:10.400337 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.401400 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.402701 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.403427 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.403498 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.403544 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.403949 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.403992 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6200,"thread_start_us":56,"threads_started":1}
I20260811 14:28:10.404696 3295 tablet_service.cc:1467] Processing CreateTablet for tablet 77084e6c314e4b4c8c29546897761710 (DEFAULT_TABLE table=test-table [id=8708e8f2639244d6ad25410f2e6d0448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:10.405018 3295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77084e6c314e4b4c8c29546897761710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:10.411947 3405 tablet_bootstrap.cc:492] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: No bootstrap required, opened a new log
I20260811 14:28:10.412115 3405 ts_tablet_manager.cc:1397] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260811 14:28:10.414837 3405 raft_consensus.cc:348] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.415058 3409 tablet_bootstrap.cc:492] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Bootstrap starting.
I20260811 14:28:10.415019 3405 raft_consensus.cc:374] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:10.415194 3405 raft_consensus.cc:729] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec92e75363646c387d5c687a16fd01d, State: Initialized, Role: FOLLOWER
I20260811 14:28:10.415428 3405 consensus_queue.cc:260] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.415803 3409 tablet_bootstrap.cc:654] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:10.415861 3405 ts_tablet_manager.cc:1428] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 14:28:10.416028 3222 heartbeater.cc:503] Master 127.20.132.254:43293 was elected leader, sending a full tablet report...
I20260811 14:28:10.416541 3408 tablet_bootstrap.cc:492] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: Bootstrap starting.
I20260811 14:28:10.417737 3408 tablet_bootstrap.cc:654] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:10.418151 3409 log.cc:824] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:10.418206 3408 log.cc:824] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:10.419512 3409 tablet_bootstrap.cc:492] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: No bootstrap required, opened a new log
I20260811 14:28:10.419608 3409 ts_tablet_manager.cc:1397] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 14:28:10.422252 3409 raft_consensus.cc:348] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.422417 3409 raft_consensus.cc:374] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:10.422501 3409 raft_consensus.cc:729] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43dee926b38549ff873490c39581084b, State: Initialized, Role: FOLLOWER
I20260811 14:28:10.422688 3409 consensus_queue.cc:260] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.422976 3409 ts_tablet_manager.cc:1428] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:28:10.423110 3367 heartbeater.cc:503] Master 127.20.132.254:43293 was elected leader, sending a full tablet report...
I20260811 14:28:10.424381 3408 tablet_bootstrap.cc:492] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: No bootstrap required, opened a new log
I20260811 14:28:10.424454 3408 ts_tablet_manager.cc:1397] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 14:28:10.426718 3408 raft_consensus.cc:348] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.426887 3408 raft_consensus.cc:374] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:10.426935 3408 raft_consensus.cc:729] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa1843800e348c7bedec980f9c0597c, State: Initialized, Role: FOLLOWER
I20260811 14:28:10.427052 3408 consensus_queue.cc:260] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.427311 3408 ts_tablet_manager.cc:1428] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:28:10.427469 3074 heartbeater.cc:503] Master 127.20.132.254:43293 was elected leader, sending a full tablet report...
W20260811 14:28:10.450439 3076 tablet.cc:2369] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:28:10.463249 3410 raft_consensus.cc:482] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:10.463379 3410 raft_consensus.cc:504] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.463770 3410 leader_election.cc:288] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43dee926b38549ff873490c39581084b (127.20.132.195:43259), 9aa1843800e348c7bedec980f9c0597c (127.20.132.193:45243)
I20260811 14:28:10.469302 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.464784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:55631 (local address 127.20.132.195:43259)
0811 14:28:10.464856 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.464860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.465036 (+ 176us) server_negotiation.cc:407] Connection header received
0811 14:28:10.465138 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.465139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.465149 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.465188 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:10.465798 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.466560 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.468168 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.468783 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.468849 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.468859 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.469172 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.469228 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 14:28:10.469756 3416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.464187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43259 (local address 127.20.132.194:55631)
0811 14:28:10.464964 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:10.464977 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:10.465065 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:10.465257 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:10.465258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:10.465259 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:10.465707 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.465711 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.466663 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.466664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.468041 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.468045 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.468987 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.468987 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.469080 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.469084 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:10.469613 (+ 529us) client_negotiation.cc:240] Negotiation successful
0811 14:28:10.469658 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"thread_start_us":127,"threads_started":1}
I20260811 14:28:10.470253 3312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77084e6c314e4b4c8c29546897761710" candidate_uuid: "2ec92e75363646c387d5c687a16fd01d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43dee926b38549ff873490c39581084b" is_pre_election: true
I20260811 14:28:10.470424 3312 raft_consensus.cc:2454] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec92e75363646c387d5c687a16fd01d in term 0.
I20260811 14:28:10.470777 3100 leader_election.cc:302] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec92e75363646c387d5c687a16fd01d, 43dee926b38549ff873490c39581084b; no voters:
I20260811 14:28:10.471030 3410 raft_consensus.cc:2781] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:28:10.471083 3410 raft_consensus.cc:482] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:28:10.471105 3410 raft_consensus.cc:3037] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:10.472055 3410 raft_consensus.cc:504] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.472206 3410 leader_election.cc:288] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [CANDIDATE]: Term 1 election: Requested vote from peers 43dee926b38549ff873490c39581084b (127.20.132.195:43259), 9aa1843800e348c7bedec980f9c0597c (127.20.132.193:45243)
I20260811 14:28:10.472505 3312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77084e6c314e4b4c8c29546897761710" candidate_uuid: "2ec92e75363646c387d5c687a16fd01d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43dee926b38549ff873490c39581084b"
I20260811 14:28:10.472579 3312 raft_consensus.cc:3037] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:10.473433 3312 raft_consensus.cc:2454] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec92e75363646c387d5c687a16fd01d in term 1.
I20260811 14:28:10.473654 3100 leader_election.cc:302] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec92e75363646c387d5c687a16fd01d, 43dee926b38549ff873490c39581084b; no voters:
I20260811 14:28:10.473788 3410 raft_consensus.cc:2781] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:10.473961 3410 raft_consensus.cc:686] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 1 LEADER]: Becoming Leader. State: Replica: 2ec92e75363646c387d5c687a16fd01d, State: Running, Role: LEADER
I20260811 14:28:10.474061 3410 consensus_queue.cc:237] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } }
I20260811 14:28:10.474993 2854 catalog_manager.cc:5495] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ec92e75363646c387d5c687a16fd01d (127.20.132.194). New cstate: current_term: 1 leader_uuid: "2ec92e75363646c387d5c687a16fd01d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec92e75363646c387d5c687a16fd01d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 32875 } health_report { overall_health: HEALTHY } } }
I20260811 14:28:10.479326 3404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.464843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:55263 (local address 127.20.132.193:45243)
0811 14:28:10.464886 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.464888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.476106 (+ 11218us) server_negotiation.cc:407] Connection header received
0811 14:28:10.476257 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.476258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.476269 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.476299 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:10.476471 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.477142 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.478411 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.478949 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.478999 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.479007 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.479221 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.479262 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:28:10.479696 3416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.464539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45243 (local address 127.20.132.194:55263)
0811 14:28:10.476051 (+ 11512us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:10.476062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:10.476133 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:10.476363 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:10.476363 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:10.476365 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:10.476398 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.476400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.477256 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.477256 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.478305 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:10.478308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.479067 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.479067 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:10.479123 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.479126 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:10.479593 (+ 467us) client_negotiation.cc:240] Negotiation successful
0811 14:28:10.479634 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11500,"thread_start_us":78,"threads_started":1}
I20260811 14:28:10.480217 3021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77084e6c314e4b4c8c29546897761710" candidate_uuid: "2ec92e75363646c387d5c687a16fd01d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa1843800e348c7bedec980f9c0597c" is_pre_election: true
I20260811 14:28:10.480365 3021 raft_consensus.cc:2454] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec92e75363646c387d5c687a16fd01d in term 0.
I20260811 14:28:10.480476 3020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77084e6c314e4b4c8c29546897761710" candidate_uuid: "2ec92e75363646c387d5c687a16fd01d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa1843800e348c7bedec980f9c0597c"
I20260811 14:28:10.480531 3020 raft_consensus.cc:3037] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:10.481353 3020 raft_consensus.cc:2454] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec92e75363646c387d5c687a16fd01d in term 1.
I20260811 14:28:10.489249 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.486030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34160 (local address 127.20.132.194:32875)
0811 14:28:10.486067 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:10.486069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:10.486075 (+ 6us) server_negotiation.cc:407] Connection header received
0811 14:28:10.486103 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:10.486104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:10.486120 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:10.486190 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:10.486364 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.487032 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.488193 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:10.488490 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:10.488550 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:10.488748 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:10.488867 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:28:10.488936 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:10.489152 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 14:28:10.489171 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:28:10.491237 3020 raft_consensus.cc:1261] T 77084e6c314e4b4c8c29546897761710 P 9aa1843800e348c7bedec980f9c0597c [term 1 FOLLOWER]: Refusing update from remote peer 2ec92e75363646c387d5c687a16fd01d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:10.491595 3417 consensus_queue.cc:1035] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa1843800e348c7bedec980f9c0597c" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:10.493587 3312 raft_consensus.cc:1261] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 1 FOLLOWER]: Refusing update from remote peer 2ec92e75363646c387d5c687a16fd01d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:10.493877 3417 consensus_queue.cc:1035] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43dee926b38549ff873490c39581084b" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:10.497270 3420 mvcc.cc:205] Tried to move back new op lower bound from 7317333977049526272 to 7317333976982290432. Current Snapshot: MvccSnapshot[applied={T|T < 7317333977049526272}]
I20260811 14:28:10.498342 3423 mvcc.cc:205] Tried to move back new op lower bound from 7317333977049526272 to 7317333976982290432. Current Snapshot: MvccSnapshot[applied={T|T < 7317333977049526272}]
I20260811 14:28:10.500486 3421 mvcc.cc:205] Tried to move back new op lower bound from 7317333977049526272 to 7317333976982290432. Current Snapshot: MvccSnapshot[applied={T|T < 7317333977049526272}]
I20260811 14:28:10.501931 2854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:10.502017 2854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:10.502741 2854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c6a5e71b06140f99cb24a16614079a1: Sending DeleteTablet for 3 replicas of tablet 77084e6c314e4b4c8c29546897761710
I20260811 14:28:10.503255 3295 tablet_service.cc:1514] Processing DeleteTablet for tablet 77084e6c314e4b4c8c29546897761710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:10 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:55922
I20260811 14:28:10.503505 2978 tablet_service.cc:1514] Processing DeleteTablet for tablet 77084e6c314e4b4c8c29546897761710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:10 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:46258
I20260811 14:28:10.503703 3148 tablet_service.cc:1514] Processing DeleteTablet for tablet 77084e6c314e4b4c8c29546897761710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:10 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:34158
I20260811 14:28:10.504455 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 2896
I20260811 14:28:10.512276 3429 tablet_replica.cc:330] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: stopping tablet replica
I20260811 14:28:10.512395 3429 raft_consensus.cc:2229] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:10.512512 3429 raft_consensus.cc:2258] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:10.517098 3431 tablet_replica.cc:330] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: stopping tablet replica
I20260811 14:28:10.517216 3431 raft_consensus.cc:2229] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:28:10.517364 3431 raft_consensus.cc:2258] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:10.517890 3431 ts_tablet_manager.cc:1905] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:10.517928 3429 ts_tablet_manager.cc:1905] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 14:28:10.519763 2840 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:45243 (error 108)
I20260811 14:28:10.520126 3431 ts_tablet_manager.cc:1918] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:10.520227 3431 log.cc:1196] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/77084e6c314e4b4c8c29546897761710
I20260811 14:28:10.520238 3429 ts_tablet_manager.cc:1918] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:10.520303 3429 log.cc:1196] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/77084e6c314e4b4c8c29546897761710
I20260811 14:28:10.520525 3431 ts_tablet_manager.cc:1939] T 77084e6c314e4b4c8c29546897761710 P 2ec92e75363646c387d5c687a16fd01d: Deleting consensus metadata
I20260811 14:28:10.520584 3429 ts_tablet_manager.cc:1939] T 77084e6c314e4b4c8c29546897761710 P 43dee926b38549ff873490c39581084b: Deleting consensus metadata
I20260811 14:28:10.520962 2838 catalog_manager.cc:4841] TS 2ec92e75363646c387d5c687a16fd01d (127.20.132.194:32875): tablet 77084e6c314e4b4c8c29546897761710 (table test-table [id=8708e8f2639244d6ad25410f2e6d0448]) successfully deleted
I20260811 14:28:10.521173 2840 catalog_manager.cc:4841] TS 43dee926b38549ff873490c39581084b (127.20.132.195:43259): tablet 77084e6c314e4b4c8c29546897761710 (table test-table [id=8708e8f2639244d6ad25410f2e6d0448]) successfully deleted
I20260811 14:28:10.528324 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3079
I20260811 14:28:10.532755 3402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:10.532615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45243 (local address 127.0.0.1:46262)
0811 14:28:10.532669 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:10.532717 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 14:28:10.532891 2840 catalog_manager.cc:4584] TS 9aa1843800e348c7bedec980f9c0597c (127.20.132.193:45243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77084e6c314e4b4c8c29546897761710: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45243: connect: Connection refused (error 111)
I20260811 14:28:10.551177 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3226
I20260811 14:28:10.558173 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 2817
I20260811 14:28:10.567065 21011 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 14:28:10.911763 21011 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 14:28:10.911857 21011 mini_ranger.cc:66] Stopping Ranger...
I20260811 14:28:11.257380 21011 mini_ranger.cc:68] Stopped Ranger
2026-08-11 14:28:11.257 UTC [1762] LOG: received smart shutdown request
2026-08-11 14:28:11.261 UTC [1762] LOG: background worker "logical replication launcher" (PID 1771) exited with exit code 1
2026-08-11 14:28:11.262 UTC [1766] LOG: shutting down
2026-08-11 14:28:11.434 UTC [1762] LOG: database system is shut down
2026-08-11T14:28:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49949 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:28:11 dist-test-slave-cbbz krb5kdc[3442](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:28:11 dist-test-slave-cbbz krb5kdc[3442](info): set up 2 sockets
Aug 11 14:28:11 dist-test-slave-cbbz krb5kdc[3442](info): commencing operation
krb5kdc: starting...
W20260811 14:28:12.666424 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:28:12 dist-test-slave-cbbz krb5kdc[3442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:28:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:28:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:28:12.785265 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:38823
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:38823,127.20.132.253:34811,127.20.132.252:39707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:12.865521 3455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:12.865743 3455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:12.865782 3455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:12.866902 3455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:12.866964 3455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:12.866990 3455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:12.867019 3455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:12.867049 3455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:12.868541 3455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:38823,127.20.132.253:34811,127.20.132.252:39707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:38823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:12.868791 3455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:12.869002 3455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:12.873929 3462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:12.873950 3464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:12.873967 3455 server_base.cc:1034] running on GCE node
W20260811 14:28:12.873945 3461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:12.874447 3455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:12.874737 3455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:12.875880 3455 hybrid_clock.cc:648] HybridClock initialized: now 1786458492875870 us; error 33 us; skew 500 ppm
Aug 11 14:28:12 dist-test-slave-cbbz krb5kdc[3442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:12.883329 3455 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:12.883790 3455 webserver.cc:460] Webserver started at http://127.20.132.254:35285/ using document root <none> and password file <none>
I20260811 14:28:12.884006 3455 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:12.884073 3455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:12.884249 3455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:12.885288 3455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "34fb1fe5fc3b4ff48f86eec7f7161694"
format_stamp: "Formatted at 2026-08-11 14:28:12 on dist-test-slave-cbbz"
server_key: "d51b5e86de9760d06c249defebb5be62"
server_key_iv: "f0adb4f25ee8e7e2f026565edef89cac"
server_key_version: "encryptionkey@0"
I20260811 14:28:12.885648 3455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "34fb1fe5fc3b4ff48f86eec7f7161694"
format_stamp: "Formatted at 2026-08-11 14:28:12 on dist-test-slave-cbbz"
server_key: "d51b5e86de9760d06c249defebb5be62"
server_key_iv: "f0adb4f25ee8e7e2f026565edef89cac"
server_key_version: "encryptionkey@0"
I20260811 14:28:12.886981 3455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:28:12.887697 3472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:12.887894 3455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:12.887986 3455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "34fb1fe5fc3b4ff48f86eec7f7161694"
format_stamp: "Formatted at 2026-08-11 14:28:12 on dist-test-slave-cbbz"
server_key: "d51b5e86de9760d06c249defebb5be62"
server_key_iv: "f0adb4f25ee8e7e2f026565edef89cac"
server_key_version: "encryptionkey@0"
I20260811 14:28:12.888041 3455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:12.897224 3455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:12.898929 3455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:12.899034 3455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:12.902837 3455 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:38823
I20260811 14:28:12.902872 3528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:38823 every 8 connection(s)
I20260811 14:28:12.903201 3455 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:12.904122 3529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:12.905731 3529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:12.909574 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3455
I20260811 14:28:12.909722 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:28:12.909915 21011 external_mini_cluster.cc:1428] Setting key ff3174acf4bd4afa460eb7c5c19f9448
Aug 11 14:28:12 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:12.915652 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:12.906525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48484 (local address 127.20.132.254:38823)
0811 14:28:12.906640 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:12.906644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:12.906676 (+ 32us) server_negotiation.cc:407] Connection header received
0811 14:28:12.907244 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:12.907247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:12.907264 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:12.907365 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:12.907895 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:12.908761 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:12.909660 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:12.910123 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:12.910238 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:12.912346 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:12.912353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:12.912354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:12.912361 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:12.914029 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:12.914421 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:12.914424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:12.914425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:12.914504 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:12.914760 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:12.914761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:12.914761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:12.914982 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:12.915077 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:12.915273 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 14:28:12.915405 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":42,"threads_started":1}
I20260811 14:28:12.915652 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:12.906380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38823 (local address 127.0.0.1:48484)
0811 14:28:12.906532 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:12.906566 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:12.907049 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:12.907368 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:12.907371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:12.907639 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:12.907790 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:12.907795 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:12.908860 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:12.908861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:12.909556 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:12.909558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:12.910208 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:12.910209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:12.910282 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:12.910825 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:12.910833 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:12.912251 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:12.914118 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:12.914124 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:12.914126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:12.914323 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:12.914593 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:12.914593 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:12.914594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:12.914682 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:12.915056 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:12.915069 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:12.915131 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 14:28:12.915239 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 14:28:12.915470 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":92,"thread_start_us":65,"threads_started":1}
I20260811 14:28:12.916682 3529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:12.917094 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:12.916970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48072)
0811 14:28:12.917022 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:12.917073 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 14:28:12.917271 3473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.132.253@KRBTEST.COM; defaulting to no policy
I20260811 14:28:12.917747 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:12.917626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48086)
0811 14:28:12.917691 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:12.917725 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 14:28:12.917855 3529 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:34811: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab.
Entry for principal kudu/127.20.132.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab.
I20260811 14:28:12.935051 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:34811
--webserver_interface=127.20.132.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab
--principal=kudu/127.20.132.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:38823,127.20.132.253:34811,127.20.132.252:39707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:12.967157 3529 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } attempt: 1
I20260811 14:28:12.967763 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:12.967601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48098)
0811 14:28:12.967697 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:12.967731 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 14:28:12.968232 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:12.968110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48112)
0811 14:28:12.968174 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:12.968203 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 14:28:12.968329 3529 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:34811: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
W20260811 14:28:13.016901 3536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:13.017124 3536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:13.017149 3536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:13.018306 3536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:13.018354 3536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:13.018370 3536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:13.018416 3536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:13.018451 3536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:13.019932 3536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:38823,127.20.132.253:34811,127.20.132.252:39707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab
--principal=kudu/127.20.132.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:34811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.132.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:13.020238 3536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:13.020479 3536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:13.025285 3543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:13.025368 3546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:13.025342 3536 server_base.cc:1034] running on GCE node
W20260811 14:28:13.025285 3542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:13.025854 3536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:13.026147 3536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:13.027310 3536 hybrid_clock.cc:648] HybridClock initialized: now 1786458493027302 us; error 45 us; skew 500 ppm
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:13.029881 3536 init.cc:377] Logged in from keytab as kudu/127.20.132.253@KRBTEST.COM (short username kudu)
I20260811 14:28:13.030284 3536 webserver.cc:460] Webserver started at http://127.20.132.253:36123/ using document root <none> and password file <none>
I20260811 14:28:13.030516 3536 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:13.030560 3536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:13.030718 3536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:13.031734 3536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data/instance:
uuid: "ea4f774aafc44a6dbe11747d23677b03"
format_stamp: "Formatted at 2026-08-11 14:28:13 on dist-test-slave-cbbz"
server_key: "b6d556015bd0302cd9e495a84dc8c75e"
server_key_iv: "df14a8616a8d7c5c26408bb647afe604"
server_key_version: "encryptionkey@0"
I20260811 14:28:13.032086 3536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal/instance:
uuid: "ea4f774aafc44a6dbe11747d23677b03"
format_stamp: "Formatted at 2026-08-11 14:28:13 on dist-test-slave-cbbz"
server_key: "b6d556015bd0302cd9e495a84dc8c75e"
server_key_iv: "df14a8616a8d7c5c26408bb647afe604"
server_key_version: "encryptionkey@0"
I20260811 14:28:13.033402 3536 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:13.034078 3553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:13.034253 3536 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:13.034354 3536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal
uuid: "ea4f774aafc44a6dbe11747d23677b03"
format_stamp: "Formatted at 2026-08-11 14:28:13 on dist-test-slave-cbbz"
server_key: "b6d556015bd0302cd9e495a84dc8c75e"
server_key_iv: "df14a8616a8d7c5c26408bb647afe604"
server_key_version: "encryptionkey@0"
I20260811 14:28:13.034449 3536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:13.036473 3529 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } attempt: 2
I20260811 14:28:13.036861 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.036734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48116)
0811 14:28:13.036793 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.036830 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 14:28:13.037245 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.037159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48130)
0811 14:28:13.037203 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.037227 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 14:28:13.037350 3529 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:34811: Network error: Client connection negotiation failed: client connection to 127.20.132.253:34811: connect: Connection refused (error 111)
I20260811 14:28:13.045394 3536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:13.047612 3536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:13.047777 3536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:13.051777 3536 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.253:34811
I20260811 14:28:13.051829 3609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.253:34811 every 8 connection(s)
I20260811 14:28:13.052248 3536 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
I20260811 14:28:13.053114 3610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:13.054581 3610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:13.059842 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3536
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:13.059980 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-1/wal/instance
I20260811 14:28:13.060221 21011 external_mini_cluster.cc:1428] Setting key 9cff7c2b71fa1a06f3cebf8267e2ed74
I20260811 14:28:13.063722 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.055308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48486 (local address 127.20.132.254:38823)
0811 14:28:13.055368 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.055370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.055517 (+ 147us) server_negotiation.cc:407] Connection header received
0811 14:28:13.055947 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.055947 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.055958 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.056018 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.056689 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.057152 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.058060 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.058249 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.058300 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.060516 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.060518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.060519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.060527 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.062261 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.062684 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.062685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.062686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.062749 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.063012 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.063013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.063013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.063166 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.063233 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.063542 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.063629 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:28:13.063946 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.055232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38823 (local address 127.0.0.1:48486)
0811 14:28:13.055387 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.055427 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.055867 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.056083 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.056086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.056420 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.056608 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.056612 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.057232 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.057233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.057984 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.057986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.058320 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.058321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.058419 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.058914 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.058922 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.060421 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.062345 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.062353 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.062356 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.062585 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.062818 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.062819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.062820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.062935 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.063237 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.063245 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.063412 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.063522 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.063688 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":83,"threads_started":1}
I20260811 14:28:13.064508 3610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.132.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.252@KRBTEST.COM" created.
I20260811 14:28:13.072402 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.064792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48136)
0811 14:28:13.064827 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.064838 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.064879 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.065151 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.065152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.065262 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.065309 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.065310 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.066715 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.066715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.067196 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.067197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.067834 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.067835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.067887 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.068330 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.068334 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.069496 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.071312 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.071313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.071314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.071481 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.071707 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.071707 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.071708 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.071770 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.072054 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.072055 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.072093 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.072186 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.072287 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 14:28:13.072501 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.064826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48136 (local address 127.20.132.253:34811)
0811 14:28:13.064980 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.064985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.065013 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:28:13.065037 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.065039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.065055 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.065143 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.065385 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.066618 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.067283 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.067750 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.067823 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.069579 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.069588 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.069589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.069596 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.071201 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.071557 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.071559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.071559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.071610 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.071841 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.071842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.071842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.071976 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.072063 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.072223 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.072358 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260811 14:28:13.073084 3610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:13.073496 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.073395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39098)
0811 14:28:13.073431 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.073473 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 14:28:13.073655 3556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
I20260811 14:28:13.074077 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.073993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39108)
0811 14:28:13.074036 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.074061 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 14:28:13.074195 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:39707: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab.
Entry for principal kudu/127.20.132.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab.
I20260811 14:28:13.087508 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:39707
--webserver_interface=127.20.132.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab
--principal=kudu/127.20.132.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:38823,127.20.132.253:34811,127.20.132.252:39707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:13.123427 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } attempt: 1
I20260811 14:28:13.123960 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.123812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39116)
0811 14:28:13.123882 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.123925 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 14:28:13.124370 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.124260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39124)
0811 14:28:13.124312 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.124348 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 14:28:13.124476 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:39707: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
I20260811 14:28:13.128496 3529 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } attempt: 3
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
I20260811 14:28:13.136262 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.128806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48144)
0811 14:28:13.128860 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.128890 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.128981 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.129169 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.129170 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.129347 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.129429 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.129432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.130230 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.130232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.130797 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.130799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.131294 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.131296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.131386 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.131880 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.131885 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.133419 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.135003 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.135004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.135005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.135232 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.135480 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.135481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.135482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.135577 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.135862 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.135863 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.135914 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.136006 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.136124 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 14:28:13.136262 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.128884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48144 (local address 127.20.132.253:34811)
0811 14:28:13.128966 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.128969 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.128981 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:28:13.129056 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.129057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.129072 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.129160 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.129530 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.130128 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.130887 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.131211 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.131298 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.133502 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.133504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.133504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.133511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.134920 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.135311 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.135312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.135312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.135368 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.135652 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.135654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.135654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.135779 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.135859 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.136034 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.136125 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:28:13.136793 3529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:13.137184 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.137024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39138)
0811 14:28:13.137080 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.137108 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 14:28:13.137513 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.137420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39146)
0811 14:28:13.137477 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.137500 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 14:28:13.137621 3529 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:39707: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
I20260811 14:28:13.168766 3529 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } attempt: 1
I20260811 14:28:13.169229 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.169087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39150)
0811 14:28:13.169166 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.169200 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 14:28:13.169688 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.169557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39166)
0811 14:28:13.169624 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.169653 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 14:28:13.169809 3529 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:39707: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
W20260811 14:28:13.170488 3618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:13.170683 3618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:13.170706 3618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:13.171875 3618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:13.171917 3618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:13.171932 3618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:13.171945 3618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:13.171958 3618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:13.173424 3618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:38823,127.20.132.253:34811,127.20.132.252:39707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab
--principal=kudu/127.20.132.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:39707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.132.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:13.173620 3618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:13.173801 3618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:13.178455 3624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:13.178431 3623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:13.178570 3618 server_base.cc:1034] running on GCE node
W20260811 14:28:13.178431 3628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:13.178925 3618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:13.179231 3618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:13.180395 3618 hybrid_clock.cc:648] HybridClock initialized: now 1786458493180384 us; error 38 us; skew 500 ppm
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:13.182852 3618 init.cc:377] Logged in from keytab as kudu/127.20.132.252@KRBTEST.COM (short username kudu)
I20260811 14:28:13.183265 3618 webserver.cc:460] Webserver started at http://127.20.132.252:40105/ using document root <none> and password file <none>
I20260811 14:28:13.183496 3618 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:13.183562 3618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:13.183717 3618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:13.184831 3618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data/instance:
uuid: "ec40a83844624fb38f708fee37828650"
format_stamp: "Formatted at 2026-08-11 14:28:13 on dist-test-slave-cbbz"
server_key: "6e3c2f3af6ca0767af0fa45a4bc4fe36"
server_key_iv: "14bb6eb3cb36078ab71c7a2676b32e00"
server_key_version: "encryptionkey@0"
I20260811 14:28:13.185192 3618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal/instance:
uuid: "ec40a83844624fb38f708fee37828650"
format_stamp: "Formatted at 2026-08-11 14:28:13 on dist-test-slave-cbbz"
server_key: "6e3c2f3af6ca0767af0fa45a4bc4fe36"
server_key_iv: "14bb6eb3cb36078ab71c7a2676b32e00"
server_key_version: "encryptionkey@0"
I20260811 14:28:13.186455 3618 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:13.187132 3635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:13.187299 3618 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:13.187394 3618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal
uuid: "ec40a83844624fb38f708fee37828650"
format_stamp: "Formatted at 2026-08-11 14:28:13 on dist-test-slave-cbbz"
server_key: "6e3c2f3af6ca0767af0fa45a4bc4fe36"
server_key_iv: "14bb6eb3cb36078ab71c7a2676b32e00"
server_key_version: "encryptionkey@0"
I20260811 14:28:13.187469 3618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:13.192611 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } attempt: 2
I20260811 14:28:13.192966 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.192845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39172)
0811 14:28:13.192903 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.192937 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 14:28:13.193313 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.193232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39176)
0811 14:28:13.193272 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.193296 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 14:28:13.193413 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:39707: Network error: Client connection negotiation failed: client connection to 127.20.132.252:39707: connect: Connection refused (error 111)
I20260811 14:28:13.211804 3618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:13.213711 3618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:13.213860 3618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:13.217710 3618 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.252:39707
I20260811 14:28:13.217746 3689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.252:39707 every 8 connection(s)
I20260811 14:28:13.218166 3618 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
I20260811 14:28:13.219033 3690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:13.220608 3690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:13.222275 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3618
I20260811 14:28:13.222427 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786458335845753-21011-0/minicluster-data/master-2/wal/instance
I20260811 14:28:13.222636 21011 external_mini_cluster.cc:1428] Setting key 44160510dce02d4d85258e7061eed41c
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:28:13.231436 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.221330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48494 (local address 127.20.132.254:38823)
0811 14:28:13.221393 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.221395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.221607 (+ 212us) server_negotiation.cc:407] Connection header received
0811 14:28:13.222165 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.222166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.222180 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.222260 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.222985 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.223769 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.225107 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.225357 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.225430 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.227889 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.227891 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.227891 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.227900 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.229966 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.230433 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.230434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.230435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.230501 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.230774 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.230775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.230775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.230895 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.230972 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.231263 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.231345 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:28:13.231573 3694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.221312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38823 (local address 127.0.0.1:48494)
0811 14:28:13.221467 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.221507 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.222062 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.222314 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.222317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.222641 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.222882 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.222886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.223861 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.223862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.225030 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.225033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.225437 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.225437 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.225540 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.226049 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.226056 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.227798 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.230076 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.230083 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.230085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.230354 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.230589 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.230590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.230590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.230704 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.230964 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.230971 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.231104 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.231207 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.231354 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":8,"thread_start_us":77,"threads_started":1}
I20260811 14:28:13.232106 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.222987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39182 (local address 127.20.132.252:39707)
0811 14:28:13.223162 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.223166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.223239 (+ 73us) server_negotiation.cc:407] Connection header received
0811 14:28:13.223298 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.223300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.223316 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.223373 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.224082 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.225207 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.226144 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.226567 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.226648 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.229153 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.229160 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.229160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.229166 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.230748 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.231097 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.231100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.231100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.231156 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.231363 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.231364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.231364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.231525 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.231719 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.231927 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.232003 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260811 14:28:13.232213 3690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:13.239319 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.232539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48148 (local address 127.20.132.253:34811)
0811 14:28:13.232581 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.232584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.232612 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:28:13.232637 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.232638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.232655 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.232712 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.232999 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.233735 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.234557 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.234849 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.234920 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.236666 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.236667 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.236668 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.236676 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.238271 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.238633 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.238634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.238634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.238693 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.238894 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.238895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.238895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.238997 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.239049 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.239204 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.239262 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:28:13.239388 3694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.232463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:34811 (local address 127.0.0.1:48148)
0811 14:28:13.232512 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.232522 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.232563 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.232726 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.232726 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.232874 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.232925 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.232926 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.233805 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.233806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.234481 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.234483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.234922 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.234922 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.234971 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.235314 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.235319 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.236585 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.238349 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.238350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.238351 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.238567 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.238760 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.238761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.238761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.238825 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.239064 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.239065 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.239109 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.239189 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.239273 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:28:13.239789 3690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:28:13.240845 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.232873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48500 (local address 127.20.132.254:38823)
0811 14:28:13.232912 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.232914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.232921 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:28:13.232943 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.232944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.232952 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.233000 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.233605 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.234233 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.235096 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.235354 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.235425 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.237804 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.237805 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.237805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.237812 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.239512 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.239943 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.239945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.239945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.240004 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.240357 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.240357 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.240358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.240457 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.240634 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.240681 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.240757 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:28:13.244946 3529 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } attempt: 2
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
I20260811 14:28:13.246878 3694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.240044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39190)
0811 14:28:13.240075 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.240088 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.240126 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.240297 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.240298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.240442 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.240469 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.240470 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.241310 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.241311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.241916 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.241919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.242368 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.242368 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.242421 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.242752 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.242757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.243897 (+ 1140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.245736 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.245737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.245737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.245952 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.246153 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.246153 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.246154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.246211 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.246517 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.246518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.246556 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.246632 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.246757 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14,"mutex_wait_us":28}
I20260811 14:28:13.247186 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.240107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39190 (local address 127.20.132.252:39707)
0811 14:28:13.240194 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.240196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.240203 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:28:13.240222 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.240227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.240235 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.240277 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.240566 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.241252 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.241999 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.242295 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.242345 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.243978 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.243979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.243979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.243985 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.245641 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.246033 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.246034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.246034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.246094 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.246281 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.246282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.246282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.246414 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.246491 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.246666 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.246818 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":68}
I20260811 14:28:13.248956 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.241488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48164 (local address 127.20.132.253:34811)
0811 14:28:13.241531 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.241533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.241542 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:13.241583 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.241584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.241593 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.241647 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.242164 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.242763 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.243389 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.243667 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.243730 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.246113 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.246114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.246115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.246121 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.247756 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.248105 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.248105 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.248106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.248229 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.248443 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.248443 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.248444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.248562 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.248762 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.248806 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.248881 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:28:13.249893 3690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: Bootstrap starting.
I20260811 14:28:13.250706 3690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:13.250926 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:28:13.251083 3690 log.cc:824] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:13.251968 3690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: No bootstrap required, opened a new log
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458492, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:28:13.254302 3690 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.254547 3690 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:13.254647 3690 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec40a83844624fb38f708fee37828650, State: Initialized, Role: FOLLOWER
I20260811 14:28:13.254845 3690 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.255235 3690 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:13.256899 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.245196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39206)
0811 14:28:13.245233 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.245242 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.245287 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.245863 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.245864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.246019 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.246060 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.246062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.247563 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.247564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.248330 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.248333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.251638 (+ 3305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.251639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.251711 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.252112 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.252118 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.253558 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.255502 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.255503 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.255503 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.255716 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.255930 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.255931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.255932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.255987 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.256589 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.256590 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.256631 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.256695 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.256794 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 14:28:13.257346 3697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.245578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39206 (local address 127.20.132.252:39707)
0811 14:28:13.245742 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.245743 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.245750 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:28:13.245766 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.245767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.245775 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.245857 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.246171 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.247448 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.248400 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.251555 (+ 3155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.251625 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.253645 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.253646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.253647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.253654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.255403 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.255800 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.255801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.255801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.255863 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.256326 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.256327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.256327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.256505 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.256561 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.257120 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.257217 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
W20260811 14:28:13.258251 3718 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:28:13.258383 3718 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:28:13.259202 3529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: Bootstrap starting.
I20260811 14:28:13.259989 3529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:13.260373 3529 log.cc:824] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:13.257714 3618 master_runner.cc:186] Error getting master registration for 127.20.132.254:38823: OK, instance_id { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" instance_seqno: 1786458492901821 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 14:28:13.260694 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.252474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48508 (local address 127.20.132.254:38823)
0811 14:28:13.252511 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.252512 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.252802 (+ 290us) server_negotiation.cc:407] Connection header received
0811 14:28:13.252905 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.252906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.252916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.252945 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.253690 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.254351 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.255392 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.255693 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.255742 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.257344 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.257346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.257346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.257354 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.258908 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.259426 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.259427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.259428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.259483 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.259707 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.259708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.259709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.259829 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.259897 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.260266 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.260343 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:28:13.260762 3618 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 14:28:13.264540 3706 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.264973 3706 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.265420 3529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: No bootstrap required, opened a new log
I20260811 14:28:13.267191 3529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.267342 3529 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:13.267395 3529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34fb1fe5fc3b4ff48f86eec7f7161694, State: Initialized, Role: FOLLOWER
I20260811 14:28:13.267521 3529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.267809 3721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.267875 3529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:13.267886 3721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.268726 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.252800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39216 (local address 127.20.132.252:39707)
0811 14:28:13.252838 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.252839 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.260666 (+ 7827us) server_negotiation.cc:407] Connection header received
0811 14:28:13.261096 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.261097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.261109 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.261165 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.261684 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.262464 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.263626 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.263928 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.264001 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.265444 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.265445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.265446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.265452 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.267208 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.267590 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.267591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.267592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.267704 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.268030 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.268031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.268032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.268205 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.268279 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.268523 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.268613 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 14:28:13.269726 3732 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:28:13.269779 3732 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:28:13.270072 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.252372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.20.132.253:34811)
0811 14:28:13.252412 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.252414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.253764 (+ 1350us) server_negotiation.cc:407] Connection header received
0811 14:28:13.253862 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.253863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.253873 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.253906 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.254700 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.255417 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.256453 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.256754 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.256794 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.262589 (+ 5795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.262590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.262590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.262597 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.264080 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.264476 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.264477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.264478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.264532 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.264772 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.264773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.264773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.264931 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.265025 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.269895 (+ 4870us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.269980 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:28:13.270615 3455 master_runner.cc:186] Error getting master registration for 127.20.132.253:34811: OK, instance_id { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" instance_seqno: 1786458493050683 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 14:28:13.273000 3455 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 14:28:13.284564 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } attempt: 3
Aug 11 14:28:13 dist-test-slave-cbbz krb5kdc[3442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458493, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:28:13.291474 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.284847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:39707 (local address 127.0.0.1:39228)
0811 14:28:13.284898 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:13.284910 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:13.284963 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:13.285107 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:13.285108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:13.285272 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:13.285313 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.285314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.285923 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.285925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.286390 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:13.286391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.286750 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.286751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:13.286807 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.287267 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:13.287272 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:13.288542 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:13.290324 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.290325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.290325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.290517 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.290765 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:13.290766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:13.290766 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:13.290869 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:13.291130 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:13.291131 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:13.291200 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 14:28:13.291263 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:28:13.291371 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 14:28:13.291474 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:13.284881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39228 (local address 127.20.132.252:39707)
0811 14:28:13.284919 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:13.284921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:13.284948 (+ 27us) server_negotiation.cc:407] Connection header received
0811 14:28:13.285022 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:13.285023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:13.285032 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:13.285103 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:13.285386 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.285847 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.286466 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:13.286678 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:13.286753 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:13.288629 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:13.288631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:13.288631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:13.288639 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:13.290249 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.290603 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.290605 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.290605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.290703 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:13.290928 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:13.290929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:13.290929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:13.291068 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:13.291127 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:13.291317 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 14:28:13.291386 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:28:13.293174 3610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: Bootstrap starting.
I20260811 14:28:13.293977 3610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:13.294288 3610 log.cc:824] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:13.295123 3610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: No bootstrap required, opened a new log
I20260811 14:28:13.296657 3610 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.296792 3610 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:13.296835 3610 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4f774aafc44a6dbe11747d23677b03, State: Initialized, Role: FOLLOWER
I20260811 14:28:13.296967 3610 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.297313 3610 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 14:28:13.298403 3560 tablet.cc:2369] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:28:13.299265 3747 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:28:13.299391 3747 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:28:13.301290 3536 master_runner.cc:263] No leader master found from master ea4f774aafc44a6dbe11747d23677b03
I20260811 14:28:13.301348 3536 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 14:28:13.297268 3736 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.301424 3736 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.314116 3736 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:13.314313 3736 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.314842 3502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ea4f774aafc44a6dbe11747d23677b03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" is_pre_election: true
I20260811 14:28:13.315009 3502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4f774aafc44a6dbe11747d23677b03 in term 0.
I20260811 14:28:13.315306 3556 leader_election.cc:302] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fb1fe5fc3b4ff48f86eec7f7161694, ea4f774aafc44a6dbe11747d23677b03; no voters:
I20260811 14:28:13.315827 3663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ea4f774aafc44a6dbe11747d23677b03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec40a83844624fb38f708fee37828650" is_pre_election: true
I20260811 14:28:13.315984 3663 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4f774aafc44a6dbe11747d23677b03 in term 0.
I20260811 14:28:13.316212 3736 leader_election.cc:288] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34fb1fe5fc3b4ff48f86eec7f7161694 (127.20.132.254:38823), ec40a83844624fb38f708fee37828650 (127.20.132.252:39707)
I20260811 14:28:13.316321 3736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:28:13.316371 3736 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:28:13.316401 3736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:13.317343 3736 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.317592 3502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ea4f774aafc44a6dbe11747d23677b03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694"
I20260811 14:28:13.317691 3502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:13.318619 3502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4f774aafc44a6dbe11747d23677b03 in term 1.
I20260811 14:28:13.318785 3556 leader_election.cc:302] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34fb1fe5fc3b4ff48f86eec7f7161694, ea4f774aafc44a6dbe11747d23677b03; no voters:
I20260811 14:28:13.319002 3663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ea4f774aafc44a6dbe11747d23677b03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec40a83844624fb38f708fee37828650"
I20260811 14:28:13.319097 3663 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:13.320014 3663 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4f774aafc44a6dbe11747d23677b03 in term 1.
I20260811 14:28:13.320255 3736 leader_election.cc:288] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [CANDIDATE]: Term 1 election: Requested vote from peers 34fb1fe5fc3b4ff48f86eec7f7161694 (127.20.132.254:38823), ec40a83844624fb38f708fee37828650 (127.20.132.252:39707)
I20260811 14:28:13.320340 3736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:13.320389 3736 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [term 1 LEADER]: Becoming Leader. State: Replica: ea4f774aafc44a6dbe11747d23677b03, State: Running, Role: LEADER
I20260811 14:28:13.320494 3736 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } }
I20260811 14:28:13.320940 3736 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea4f774aafc44a6dbe11747d23677b03. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.321019 3736 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:13.322206 3751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:13.322405 3751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:13.323850 3663 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [term 1 FOLLOWER]: Refusing update from remote peer ea4f774aafc44a6dbe11747d23677b03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:13.324203 3749 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:13.325438 3706 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea4f774aafc44a6dbe11747d23677b03. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.325532 3706 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.325896 3502 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [term 1 FOLLOWER]: Refusing update from remote peer ea4f774aafc44a6dbe11747d23677b03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:13.326162 3749 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:13.327327 3721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea4f774aafc44a6dbe11747d23677b03. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.327418 3721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.329044 3749 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.329164 3749 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:13.329484 3721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.329566 3721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.331804 3749 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.331887 3749 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:13.332442 3706 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ea4f774aafc44a6dbe11747d23677b03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34fb1fe5fc3b4ff48f86eec7f7161694" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38823 } } peers { permanent_uuid: "ea4f774aafc44a6dbe11747d23677b03" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 34811 } } peers { permanent_uuid: "ec40a83844624fb38f708fee37828650" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 39707 } } }
I20260811 14:28:13.332530 3706 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:28:13.332760 3753 mvcc.cc:205] Tried to move back new op lower bound from 7317333988652511232 to 7317333988641468416. Current Snapshot: MvccSnapshot[applied={T|T < 7317333988652511232}]
I20260811 14:28:13.333292 3755 mvcc.cc:205] Tried to move back new op lower bound from 7317333988652511232 to 7317333988641468416. Current Snapshot: MvccSnapshot[applied={T|T < 7317333988652511232}]
I20260811 14:28:13.333803 3751 catalog_manager.cc:1347] Generated new cluster ID: 8957bd93c97f46bcb28bd325aea920ec
I20260811 14:28:13.333854 3751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:13.341665 3751 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:28:13.342410 3751 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:13.353025 3751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea4f774aafc44a6dbe11747d23677b03: Generated new TSK 0
I20260811 14:28:13.353241 3751 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:28:14.258890 3718 catalog_manager.cc:1259] Loaded cluster ID: 8957bd93c97f46bcb28bd325aea920ec
I20260811 14:28:14.258970 3718 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: loading cluster ID for follower catalog manager: success
I20260811 14:28:14.259824 3718 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: acquiring CA information for follower catalog manager: success
I20260811 14:28:14.260174 3718 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ec40a83844624fb38f708fee37828650: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:28:14.270188 3732 catalog_manager.cc:1259] Loaded cluster ID: 8957bd93c97f46bcb28bd325aea920ec
I20260811 14:28:14.270272 3732 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: loading cluster ID for follower catalog manager: success
I20260811 14:28:14.271063 3732 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: acquiring CA information for follower catalog manager: success
I20260811 14:28:14.271358 3732 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 34fb1fe5fc3b4ff48f86eec7f7161694: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:28:14.409876 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3455
I20260811 14:28:14.416769 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3536
I20260811 14:28:14.423421 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3618
2026-08-11T14:28:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2873 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:28:14 dist-test-slave-cbbz krb5kdc[3769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:28:14 dist-test-slave-cbbz krb5kdc[3769](info): set up 2 sockets
Aug 11 14:28:14 dist-test-slave-cbbz krb5kdc[3769](info): commencing operation
krb5kdc: starting...
W20260811 14:28:15.606658 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:28:15 dist-test-slave-cbbz krb5kdc[3769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:28:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:28:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:28:15.730647 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41201
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:41201
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:15.812602 3783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:15.812798 3783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:15.812819 3783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:15.813982 3783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:15.814025 3783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:15.814040 3783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:15.814052 3783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:15.814096 3783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:15.815660 3783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:41201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:15.815908 3783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:15.816164 3783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:15.821048 3788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:15.821059 3789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:15.821100 3791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:15.821328 3783 server_base.cc:1034] running on GCE node
I20260811 14:28:15.821650 3783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:15.821950 3783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:15.823124 3783 hybrid_clock.cc:648] HybridClock initialized: now 1786458495823118 us; error 35 us; skew 500 ppm
Aug 11 14:28:15 dist-test-slave-cbbz krb5kdc[3769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458495, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:15.825644 3783 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:15.826097 3783 webserver.cc:460] Webserver started at http://127.20.132.254:44721/ using document root <none> and password file <none>
I20260811 14:28:15.826272 3783 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:15.826311 3783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:15.826398 3783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:15.827353 3783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "4949207db4dc47b7a6a7ec9266ce63fc"
format_stamp: "Formatted at 2026-08-11 14:28:15 on dist-test-slave-cbbz"
server_key: "b37fb2e86710cc45ce71245698ee6619"
server_key_iv: "6762ed06174ba34b7886841f7f660b55"
server_key_version: "encryptionkey@0"
I20260811 14:28:15.827656 3783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "4949207db4dc47b7a6a7ec9266ce63fc"
format_stamp: "Formatted at 2026-08-11 14:28:15 on dist-test-slave-cbbz"
server_key: "b37fb2e86710cc45ce71245698ee6619"
server_key_iv: "6762ed06174ba34b7886841f7f660b55"
server_key_version: "encryptionkey@0"
I20260811 14:28:15.828979 3783 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:28:15.829646 3798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:15.829823 3783 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:15.829905 3783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "4949207db4dc47b7a6a7ec9266ce63fc"
format_stamp: "Formatted at 2026-08-11 14:28:15 on dist-test-slave-cbbz"
server_key: "b37fb2e86710cc45ce71245698ee6619"
server_key_iv: "6762ed06174ba34b7886841f7f660b55"
server_key_version: "encryptionkey@0"
I20260811 14:28:15.829957 3783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:15.838344 3783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:15.840023 3783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:15.840128 3783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:15.844043 3783 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:41201
I20260811 14:28:15.844116 3857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:41201 every 8 connection(s)
I20260811 14:28:15.844462 3783 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:15.845345 3858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:15.845811 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3783
I20260811 14:28:15.845884 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:28:15.846082 21011 external_mini_cluster.cc:1428] Setting key 995598c24d3ae66fe45b0e7cb2c44c33
I20260811 14:28:15.848410 3858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc: Bootstrap starting.
I20260811 14:28:15.848995 3858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:15.849298 3858 log.cc:824] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:15.850016 3858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc: No bootstrap required, opened a new log
I20260811 14:28:15.851794 3858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41201 } }
I20260811 14:28:15.851951 3858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:15.852000 3858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4949207db4dc47b7a6a7ec9266ce63fc, State: Initialized, Role: FOLLOWER
I20260811 14:28:15.852176 3858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41201 } }
I20260811 14:28:15.852274 3858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:15.852320 3858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:15.852370 3858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 0 FOLLOWER]: Advancing to term 1
Aug 11 14:28:15 dist-test-slave-cbbz krb5kdc[3769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:15.852973 3858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41201 } }
I20260811 14:28:15.853107 3858 leader_election.cc:302] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4949207db4dc47b7a6a7ec9266ce63fc; no voters:
I20260811 14:28:15.853297 3858 leader_election.cc:288] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:28:15.853341 3865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:15.853502 3865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [term 1 LEADER]: Becoming Leader. State: Replica: 4949207db4dc47b7a6a7ec9266ce63fc, State: Running, Role: LEADER
I20260811 14:28:15.853549 3858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:15.853636 3865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41201 } }
I20260811 14:28:15.854019 3867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4949207db4dc47b7a6a7ec9266ce63fc. Latest consensus state: current_term: 1 leader_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41201 } } }
I20260811 14:28:15.854128 3867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:15.854507 3866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4949207db4dc47b7a6a7ec9266ce63fc" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41201 } } }
I20260811 14:28:15.854591 3866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc [sys.catalog]: This master's current role is: LEADER
W20260811 14:28:15.855756 3880 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:28:15.855860 3880 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:28:15.856029 3881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:15.856228 3881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:15.857275 3863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:15.846580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.20.132.254:41201)
0811 14:28:15.846798 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:15.846807 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:15.846841 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:28:15.847366 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:15.847375 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:15.847433 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:15.847595 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:15.848246 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:15.849170 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:15.850097 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:15.850513 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:15.850633 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:15.853063 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:15.853067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:15.853067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:15.853079 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:15.855515 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:15.855934 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:15.855937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:15.855938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:15.856037 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:15.856324 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:15.856325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:15.856325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:15.856616 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:15.856766 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:15.856911 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 14:28:15.857046 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260811 14:28:15.857846 3881 catalog_manager.cc:1347] Generated new cluster ID: 18c8d69bb8b8498a8e04cb3c8a40d2b8
I20260811 14:28:15.857939 3881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:15.858139 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:28:15.893530 3881 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:28:15.894110 3881 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:15.898974 3881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4949207db4dc47b7a6a7ec9266ce63fc: Generated new TSK 0
I20260811 14:28:15.899149 3881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:28:15.912379 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3783
2026-08-11T14:28:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1489 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:28:15 dist-test-slave-cbbz krb5kdc[3889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:28:15 dist-test-slave-cbbz krb5kdc[3889](info): set up 2 sockets
Aug 11 14:28:15 dist-test-slave-cbbz krb5kdc[3889](info): commencing operation
krb5kdc: starting...
W20260811 14:28:17.030371 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:28:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:28:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:28:17.150843 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37175
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:17.231802 3904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:17.232040 3904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:17.232075 3904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:17.233260 3904 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:17.233336 3904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:17.233359 3904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:17.233381 3904 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:17.233412 3904 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:17.234910 3904 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:17.235188 3904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:17.235432 3904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:17.240342 3909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:17.240386 3904 server_base.cc:1034] running on GCE node
W20260811 14:28:17.240392 3910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:17.240358 3912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:17.240787 3904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:17.241074 3904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:17.242218 3904 hybrid_clock.cc:648] HybridClock initialized: now 1786458497242207 us; error 28 us; skew 500 ppm
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:17.244611 3904 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:17.245038 3904 webserver.cc:460] Webserver started at http://127.20.132.254:41017/ using document root <none> and password file <none>
I20260811 14:28:17.245304 3904 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:17.245386 3904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:17.245548 3904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:17.246663 3904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f5e9645a666ab912a61e7b8cfa23b906"
server_key_iv: "104529f689093c77ae4e5e4e8abed66c"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.246958 3904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f5e9645a666ab912a61e7b8cfa23b906"
server_key_iv: "104529f689093c77ae4e5e4e8abed66c"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.248266 3904 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:28:17.248955 3919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.249126 3904 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:17.249231 3904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f5e9645a666ab912a61e7b8cfa23b906"
server_key_iv: "104529f689093c77ae4e5e4e8abed66c"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.249303 3904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:17.275660 3904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:17.277549 3904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:17.277719 3904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:17.281798 3904 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37175
I20260811 14:28:17.281836 3975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37175 every 8 connection(s)
I20260811 14:28:17.282188 3904 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:17.283125 3976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:17.285490 3976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap starting.
I20260811 14:28:17.286073 3976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:17.286257 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 3904
I20260811 14:28:17.286378 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:28:17.286414 3976 log.cc:824] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:17.286586 21011 external_mini_cluster.cc:1428] Setting key dfc34e704c4093388c3451a6d009932c
I20260811 14:28:17.287197 3976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: No bootstrap required, opened a new log
I20260811 14:28:17.289815 3976 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:17.289986 3976 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:17.290023 3976 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cddf99fe5384aeda09fb7cf0d54c1c2, State: Initialized, Role: FOLLOWER
I20260811 14:28:17.290143 3976 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:17.290228 3976 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:17.290256 3976 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:17.290298 3976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:17.290916 3976 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:17.291039 3976 leader_election.cc:302] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cddf99fe5384aeda09fb7cf0d54c1c2; no voters:
I20260811 14:28:17.291225 3976 leader_election.cc:288] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:28:17.291260 3981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:17.291424 3981 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 LEADER]: Becoming Leader. State: Replica: 8cddf99fe5384aeda09fb7cf0d54c1c2, State: Running, Role: LEADER
I20260811 14:28:17.291491 3976 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:17.291556 3981 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:17.291926 3981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cddf99fe5384aeda09fb7cf0d54c1c2. Latest consensus state: current_term: 1 leader_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } } }
I20260811 14:28:17.291939 3984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } } }
I20260811 14:28:17.292075 3981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:17.292083 3984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:17.292433 3991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:17.293094 3991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:17.295363 3991 catalog_manager.cc:1347] Generated new cluster ID: aea28581fa614f4ebae1878f5aab1dc3
I20260811 14:28:17.295449 3991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:17.297755 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.287083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38334 (local address 127.20.132.254:37175)
0811 14:28:17.287280 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.287289 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.287321 (+ 32us) server_negotiation.cc:407] Connection header received
0811 14:28:17.287722 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.287728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.287772 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.287877 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:17.288716 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.289572 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.290637 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.291049 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.291187 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.294146 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:17.294158 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:17.294158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:17.294169 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:17.296136 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.296526 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.296529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.296530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.296639 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.296857 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.296858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.296858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.297160 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:17.297320 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.297400 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.297539 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":103,"threads_started":1}
I20260811 14:28:17.337462 3991 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:28:17.338052 3991 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:17.342903 3991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Generated new TSK 0
I20260811 14:28:17.343101 3991 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:28:17.382694 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37175
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:17.463608 4005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:17.463814 4005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:17.463835 4005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:17.464988 4005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:17.465029 4005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:17.465055 4005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:17.466492 4005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:17.466729 4005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:17.466984 4005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:17.471903 4012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:17.471920 4014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:17.471930 4011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:17.472092 4005 server_base.cc:1034] running on GCE node
I20260811 14:28:17.472322 4005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:17.472568 4005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:17.473709 4005 hybrid_clock.cc:648] HybridClock initialized: now 1786458497473697 us; error 28 us; skew 500 ppm
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:17.476110 4005 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:17.476532 4005 webserver.cc:460] Webserver started at http://127.20.132.193:37453/ using document root <none> and password file <none>
I20260811 14:28:17.476706 4005 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:17.476747 4005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:17.476830 4005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:17.477805 4005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "c538f733c6024693ac3223ac69e2e3a4"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f7e4888524f7e4b616d1fddd116170a0"
server_key_iv: "4748e766df19676c10909ab58c03bc9f"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.478116 4005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "c538f733c6024693ac3223ac69e2e3a4"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f7e4888524f7e4b616d1fddd116170a0"
server_key_iv: "4748e766df19676c10909ab58c03bc9f"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.479324 4005 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:17.479945 4022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.480130 4005 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:17.480304 4005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "c538f733c6024693ac3223ac69e2e3a4"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f7e4888524f7e4b616d1fddd116170a0"
server_key_iv: "4748e766df19676c10909ab58c03bc9f"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.480388 4005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:17.497967 4005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:17.499818 4005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:17.499981 4005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:17.500252 4005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:17.500595 4005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:17.500649 4005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.500684 4005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:17.500715 4005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.506632 4005 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:45253
I20260811 14:28:17.506695 4143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:45253 every 8 connection(s)
I20260811 14:28:17.506982 4005 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:28:17.507565 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4005
I20260811 14:28:17.507685 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:28:17.507915 21011 external_mini_cluster.cc:1428] Setting key ddcea2af0eddce9c3cfbd7f73b4b5a8a
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
I20260811 14:28:17.518064 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.507738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:40697 (local address 127.20.132.254:37175)
0811 14:28:17.507811 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.507813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.508042 (+ 229us) server_negotiation.cc:407] Connection header received
0811 14:28:17.508673 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.508681 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.508693 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.508756 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:17.509659 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.510462 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.511871 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.512262 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.512337 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.514752 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:17.514754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:17.514754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:17.514764 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:17.516612 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.517010 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.517011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.517011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.517073 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.517313 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.517314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.517315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.517455 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:17.517527 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.517821 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.517913 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:28:17.518093 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.507736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:40697)
0811 14:28:17.507911 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:17.507946 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:17.508545 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:17.508807 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:17.508811 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:17.509368 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:17.509551 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.509555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.510563 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.510564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.511778 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.511782 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.512351 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.512352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.512453 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.513003 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:17.513019 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:17.514644 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:17.516706 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:17.516712 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:17.516713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:17.516932 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:17.517148 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:17.517149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:17.517149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:17.517246 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:17.517522 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:17.517527 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:17.517638 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 14:28:17.517776 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 14:28:17.517910 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260811 14:28:17.518606 4144 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37175
I20260811 14:28:17.518702 4144 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:17.518896 4144 heartbeater.cc:511] Master 127.20.132.254:37175 requested a full tablet report, sending...
I20260811 14:28:17.519409 3937 ts_manager.cc:194] Registered new tserver with Master: c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253)
I20260811 14:28:17.519960 3937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:40697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:28:17.536026 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37175
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:17.619701 4149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:17.619916 4149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:17.619941 4149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:17.621184 4149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:17.621234 4149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:17.621289 4149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:17.622767 4149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:17.623078 4149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:17.623324 4149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:17.628466 4155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:17.628563 4158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:17.628473 4154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:17.628734 4149 server_base.cc:1034] running on GCE node
I20260811 14:28:17.628939 4149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:17.629189 4149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:17.630426 4149 hybrid_clock.cc:648] HybridClock initialized: now 1786458497630412 us; error 32 us; skew 500 ppm
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:17.632923 4149 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:17.633370 4149 webserver.cc:460] Webserver started at http://127.20.132.194:44507/ using document root <none> and password file <none>
I20260811 14:28:17.633554 4149 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:17.633594 4149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:17.633677 4149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:17.634635 4149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "79c263cfb36d84a242deb9e676745b2c"
server_key_iv: "5c4ae3f47597c5c8f99bf5290c4932f8"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.634920 4149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "79c263cfb36d84a242deb9e676745b2c"
server_key_iv: "5c4ae3f47597c5c8f99bf5290c4932f8"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.636127 4149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 14:28:17.636940 4165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.637125 4149 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:17.637239 4149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "79c263cfb36d84a242deb9e676745b2c"
server_key_iv: "5c4ae3f47597c5c8f99bf5290c4932f8"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.637313 4149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:17.649869 4149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:17.651623 4149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:17.651783 4149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:17.652101 4149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:17.652534 4149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:17.652587 4149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.652666 4149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:17.652701 4149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.658767 4149 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:39621
I20260811 14:28:17.658815 4285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:39621 every 8 connection(s)
I20260811 14:28:17.659103 4149 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:17.661548 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4149
I20260811 14:28:17.661664 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:28:17.661847 21011 external_mini_cluster.cc:1428] Setting key 53e849e59947ae8868f493cc5c5e7106
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:17.668977 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.659796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:36227 (local address 127.20.132.254:37175)
0811 14:28:17.659856 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.659858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.660057 (+ 199us) server_negotiation.cc:407] Connection header received
0811 14:28:17.660640 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.660642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.660655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.660719 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:17.661634 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.662267 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.663322 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.663631 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.663713 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.665849 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:17.665850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:17.665851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:17.665859 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:17.667334 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.667736 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.667737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.667738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.667798 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.668062 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.668063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.668064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.668251 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:17.668329 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.668848 (+ 519us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.668912 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:28:17.669260 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.659761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:36227)
0811 14:28:17.659941 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:17.659976 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:17.660525 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:17.660792 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:17.660796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:17.661340 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:17.661524 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.661528 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.662366 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.662367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.663233 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.663236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.663719 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.663720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.663816 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.664413 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:17.664420 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:17.665753 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:17.667430 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:17.667442 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:17.667444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:17.667657 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:17.667884 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:17.667885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:17.667885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:17.667990 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:17.668510 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:17.668517 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:17.668700 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 14:28:17.668824 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 14:28:17.669007 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260811 14:28:17.669836 4286 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37175
I20260811 14:28:17.669924 4286 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:17.670104 4286 heartbeater.cc:511] Master 127.20.132.254:37175 requested a full tablet report, sending...
I20260811 14:28:17.670508 3937 ts_manager.cc:194] Registered new tserver with Master: 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
I20260811 14:28:17.670940 3937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:36227
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:28:17.688117 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37175
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:17.769554 4291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:17.769816 4291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:17.769866 4291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:17.770942 4291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:17.771005 4291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:17.771062 4291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:17.772529 4291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:17.772779 4291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:17.773007 4291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:17.778026 4299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:17.778124 4291 server_base.cc:1034] running on GCE node
W20260811 14:28:17.778036 4297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:17.778025 4296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:17.778476 4291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:17.778724 4291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:17.779862 4291 hybrid_clock.cc:648] HybridClock initialized: now 1786458497779849 us; error 29 us; skew 500 ppm
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:17.782483 4291 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:17.782946 4291 webserver.cc:460] Webserver started at http://127.20.132.195:46389/ using document root <none> and password file <none>
I20260811 14:28:17.783229 4291 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:17.783298 4291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:17.783453 4291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:17.784533 4291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "95f4963bd9704e87afa8330e46231959"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "bf2fddbccd69573da89b0210f7fcd76a"
server_key_iv: "28a0d16c065501aedeef472b108159f6"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.784886 4291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "95f4963bd9704e87afa8330e46231959"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "bf2fddbccd69573da89b0210f7fcd76a"
server_key_iv: "28a0d16c065501aedeef472b108159f6"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.786176 4291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:17.786872 4307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.787077 4291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:17.787171 4291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "95f4963bd9704e87afa8330e46231959"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "bf2fddbccd69573da89b0210f7fcd76a"
server_key_iv: "28a0d16c065501aedeef472b108159f6"
server_key_version: "encryptionkey@0"
I20260811 14:28:17.787223 4291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:17.819661 4291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:17.821533 4291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:17.821657 4291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:17.821869 4291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:17.822191 4291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:17.822247 4291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.822289 4291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:17.822320 4291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:17.827993 4291 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:35829
I20260811 14:28:17.828099 4432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:35829 every 8 connection(s)
I20260811 14:28:17.828440 4291 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:28:17.833204 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4291
I20260811 14:28:17.833302 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:28:17.833487 21011 external_mini_cluster.cc:1428] Setting key 9505f796e7437d1782b1283addd6fd40
Aug 11 14:28:17 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458497, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:17.837222 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.829166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:50965 (local address 127.20.132.254:37175)
0811 14:28:17.829242 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.829244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.829418 (+ 174us) server_negotiation.cc:407] Connection header received
0811 14:28:17.829890 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.829891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.829900 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.829957 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:17.830831 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.831319 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.832355 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.832537 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.832590 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.834942 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:17.834943 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:17.834944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:17.834950 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:17.836064 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.836457 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.836458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.836458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.836511 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.836727 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.836728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.836728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.836827 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:17.836877 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.837094 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.837161 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:28:17.837472 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.829119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:50965)
0811 14:28:17.829281 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:17.829322 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:17.829812 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:17.830007 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:17.830011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:17.830558 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:17.830758 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.830763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.831398 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.831398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.832285 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.832288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.832607 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.832608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.832707 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.833304 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:17.833316 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:17.834861 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:17.836131 (+ 1270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:17.836172 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:17.836174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:17.836391 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:17.836572 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:17.836572 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:17.836572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:17.836662 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:17.836880 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:17.836885 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:17.836990 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 14:28:17.837068 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:28:17.837256 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260811 14:28:17.838029 4434 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37175
I20260811 14:28:17.838109 4434 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:17.838251 4434 heartbeater.cc:511] Master 127.20.132.254:37175 requested a full tablet report, sending...
I20260811 14:28:17.838574 3937 ts_manager.cc:194] Registered new tserver with Master: 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829)
I20260811 14:28:17.838948 3937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:50965
I20260811 14:28:17.845116 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:28:17.852427 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.846487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.20.132.254:37175)
0811 14:28:17.846523 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.846525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.846676 (+ 151us) server_negotiation.cc:407] Connection header received
0811 14:28:17.846751 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.846751 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.846762 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.846829 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:17.847413 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.847960 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.848785 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.848976 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.849059 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.850138 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:17.850139 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:17.850139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:17.850146 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:17.851214 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.851572 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.851573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.851574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.851635 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:17.851861 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:17.851862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:17.851862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:17.852007 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:17.852125 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.852255 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.852331 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:28:17.853960 3937 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38340:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:28:17.855513 3937 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:28:17.861863 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.857652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35829 (local address 127.0.0.1:59828)
0811 14:28:17.857941 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:17.857983 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:17.858057 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:17.858395 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:17.858396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:17.858399 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:17.858462 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.858464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.859776 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.859777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.860850 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.860852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.861543 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.861631 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.861644 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 14:28:17.861706 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 14:28:17.861781 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":58,"threads_started":1}
I20260811 14:28:17.861891 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.857756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59828 (local address 127.20.132.195:35829)
0811 14:28:17.858240 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.858244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.858251 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:28:17.858280 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.858281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.858292 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.858391 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:17.858549 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.859655 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.860931 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.861446 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861534 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.861590 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.861744 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.861810 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":86,"threads_started":1}
I20260811 14:28:17.862067 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.857882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52456 (local address 127.20.132.193:45253)
0811 14:28:17.858099 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.858104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.858114 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:28:17.858151 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.858153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.858168 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.858260 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:17.858488 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.859357 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.860799 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.861534 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861606 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.861655 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.861908 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.861963 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":82,"threads_started":1}
I20260811 14:28:17.862214 4450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.857963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.20.132.194:39621)
0811 14:28:17.858158 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:17.858162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:17.858610 (+ 448us) server_negotiation.cc:407] Connection header received
0811 14:28:17.858654 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:17.858656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:17.858672 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:17.858758 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:17.858893 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.859891 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861054 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.861756 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861833 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.861881 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:17.862084 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 14:28:17.862124 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":87,"threads_started":1}
I20260811 14:28:17.862226 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.857842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39621 (local address 127.0.0.1:60320)
0811 14:28:17.858490 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:17.858500 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:17.858547 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:17.858755 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:17.858756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:17.858758 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:17.858802 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.858803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.859994 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.859995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.860969 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.860972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.861920 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.862004 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.862008 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:17.862067 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 14:28:17.862108 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":68,"threads_started":1}
I20260811 14:28:17.861863 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:17.857662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45253 (local address 127.0.0.1:52456)
0811 14:28:17.857960 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:17.857990 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:17.858056 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:17.858281 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:17.858284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:17.858286 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:17.858345 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.858347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.859461 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.859462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.860705 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:17.860708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:17.861638 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:17.861639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:17.861709 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:17.861712 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:17.861758 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 14:28:17.861798 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":76,"threads_started":1}
I20260811 14:28:17.863126 4216 tablet_service.cc:1467] Processing CreateTablet for tablet 7923d66893f9419796f04bcec5b53be0 (DEFAULT_TABLE table=test-table [id=cb050dba533e4abb918cc2841e4b8c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:17.863111 4071 tablet_service.cc:1467] Processing CreateTablet for tablet 7923d66893f9419796f04bcec5b53be0 (DEFAULT_TABLE table=test-table [id=cb050dba533e4abb918cc2841e4b8c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:17.863085 4361 tablet_service.cc:1467] Processing CreateTablet for tablet 7923d66893f9419796f04bcec5b53be0 (DEFAULT_TABLE table=test-table [id=cb050dba533e4abb918cc2841e4b8c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:17.863459 4216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7923d66893f9419796f04bcec5b53be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:17.863459 4361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7923d66893f9419796f04bcec5b53be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:17.863459 4071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7923d66893f9419796f04bcec5b53be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:17.866107 4451 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Bootstrap starting.
I20260811 14:28:17.866873 4452 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Bootstrap starting.
I20260811 14:28:17.866928 4451 tablet_bootstrap.cc:654] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:17.867035 4453 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Bootstrap starting.
I20260811 14:28:17.867581 4451 log.cc:824] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:17.867831 4452 tablet_bootstrap.cc:654] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:17.868468 4451 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: No bootstrap required, opened a new log
I20260811 14:28:17.868608 4451 ts_tablet_manager.cc:1397] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:28:17.868489 4452 log.cc:824] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:17.868777 4453 tablet_bootstrap.cc:654] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:17.869366 4453 log.cc:824] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:17.869416 4452 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: No bootstrap required, opened a new log
I20260811 14:28:17.869477 4452 ts_tablet_manager.cc:1397] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 14:28:17.870025 4453 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: No bootstrap required, opened a new log
I20260811 14:28:17.870105 4453 ts_tablet_manager.cc:1397] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:28:17.870632 4451 raft_consensus.cc:348] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:17.870811 4451 raft_consensus.cc:374] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:17.870849 4451 raft_consensus.cc:729] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d66e5ba5d348998d2d4d07cbb84e89, State: Initialized, Role: FOLLOWER
I20260811 14:28:17.870997 4451 consensus_queue.cc:260] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:17.871297 4451 ts_tablet_manager.cc:1428] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:28:17.871302 4286 heartbeater.cc:503] Master 127.20.132.254:37175 was elected leader, sending a full tablet report...
I20260811 14:28:17.871529 4452 raft_consensus.cc:348] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:17.871696 4452 raft_consensus.cc:374] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:17.871733 4452 raft_consensus.cc:729] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f4963bd9704e87afa8330e46231959, State: Initialized, Role: FOLLOWER
I20260811 14:28:17.871860 4452 consensus_queue.cc:260] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:17.872172 4452 ts_tablet_manager.cc:1428] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:28:17.872172 4434 heartbeater.cc:503] Master 127.20.132.254:37175 was elected leader, sending a full tablet report...
I20260811 14:28:17.872676 4453 raft_consensus.cc:348] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:17.872844 4453 raft_consensus.cc:374] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:17.872898 4453 raft_consensus.cc:729] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538f733c6024693ac3223ac69e2e3a4, State: Initialized, Role: FOLLOWER
I20260811 14:28:17.873008 4453 consensus_queue.cc:260] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:17.873276 4144 heartbeater.cc:503] Master 127.20.132.254:37175 was elected leader, sending a full tablet report...
I20260811 14:28:17.873277 4453 ts_tablet_manager.cc:1428] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260811 14:28:17.909641 4287 tablet.cc:2369] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:28:18.007730 4145 tablet.cc:2369] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:28:18.069880 4460 raft_consensus.cc:482] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:18.069998 4460 raft_consensus.cc:504] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.070377 4460 leader_election.cc:288] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
I20260811 14:28:18.073526 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.070683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:46509 (local address 127.20.132.195:35829)
0811 14:28:18.070753 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.070756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.070861 (+ 105us) server_negotiation.cc:407] Connection header received
0811 14:28:18.070956 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.070957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.070967 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.071050 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:18.071239 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.071718 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.072748 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.073153 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.073261 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.073271 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.073418 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.073457 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:28:18.073544 4462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.070565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35829 (local address 127.20.132.193:46509)
0811 14:28:18.070750 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.070764 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.070859 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.071057 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.071058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.071061 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:18.071162 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.071164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.071813 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.071814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.072649 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.072651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.073260 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.073261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.073341 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.073345 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.073412 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.073455 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":112,"threads_started":1}
I20260811 14:28:18.073650 4450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.070882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:42093 (local address 127.20.132.194:39621)
0811 14:28:18.070935 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.070937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.071003 (+ 66us) server_negotiation.cc:407] Connection header received
0811 14:28:18.071099 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.071100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.071132 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.071212 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:18.071376 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.071834 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.072836 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.073224 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.073362 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.073371 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.073536 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.073578 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 14:28:18.073676 4464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.070802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39621 (local address 127.20.132.193:42093)
0811 14:28:18.070913 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.070925 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.071019 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.071214 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.071215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.071216 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:18.071303 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.071304 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.071920 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.071921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.072744 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.072747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.073363 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.073364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.073439 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.073443 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.073530 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.073583 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":64,"threads_started":1}
I20260811 14:28:18.074046 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7923d66893f9419796f04bcec5b53be0" candidate_uuid: "c538f733c6024693ac3223ac69e2e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" is_pre_election: true
I20260811 14:28:18.074054 4382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7923d66893f9419796f04bcec5b53be0" candidate_uuid: "c538f733c6024693ac3223ac69e2e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f4963bd9704e87afa8330e46231959" is_pre_election: true
I20260811 14:28:18.074221 4237 raft_consensus.cc:2454] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538f733c6024693ac3223ac69e2e3a4 in term 0.
I20260811 14:28:18.074240 4382 raft_consensus.cc:2454] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538f733c6024693ac3223ac69e2e3a4 in term 0.
I20260811 14:28:18.074465 4023 leader_election.cc:302] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d66e5ba5d348998d2d4d07cbb84e89, c538f733c6024693ac3223ac69e2e3a4; no voters:
I20260811 14:28:18.074631 4460 raft_consensus.cc:2781] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:28:18.074717 4460 raft_consensus.cc:482] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:28:18.074734 4460 raft_consensus.cc:3037] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:18.075451 4460 raft_consensus.cc:504] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.075582 4460 leader_election.cc:288] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 1 election: Requested vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
I20260811 14:28:18.075815 4382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7923d66893f9419796f04bcec5b53be0" candidate_uuid: "c538f733c6024693ac3223ac69e2e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f4963bd9704e87afa8330e46231959"
I20260811 14:28:18.075834 4237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7923d66893f9419796f04bcec5b53be0" candidate_uuid: "c538f733c6024693ac3223ac69e2e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
I20260811 14:28:18.075889 4382 raft_consensus.cc:3037] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:18.075910 4237 raft_consensus.cc:3037] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:18.076648 4382 raft_consensus.cc:2454] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538f733c6024693ac3223ac69e2e3a4 in term 1.
I20260811 14:28:18.076809 4237 raft_consensus.cc:2454] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538f733c6024693ac3223ac69e2e3a4 in term 1.
I20260811 14:28:18.076809 4023 leader_election.cc:302] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f4963bd9704e87afa8330e46231959, c538f733c6024693ac3223ac69e2e3a4; no voters:
I20260811 14:28:18.076948 4460 raft_consensus.cc:2781] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:18.077136 4460 raft_consensus.cc:686] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 LEADER]: Becoming Leader. State: Replica: c538f733c6024693ac3223ac69e2e3a4, State: Running, Role: LEADER
I20260811 14:28:18.077263 4460 consensus_queue.cc:237] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.078065 3937 catalog_manager.cc:5495] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "c538f733c6024693ac3223ac69e2e3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } health_report { overall_health: UNKNOWN } } }
W20260811 14:28:18.079005 4435 tablet.cc:2369] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:28:18.088054 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.086006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.20.132.193:45253)
0811 14:28:18.086046 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.086047 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.086056 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:18.086116 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.086117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.086133 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.086196 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:18.086305 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.086751 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.087438 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.087611 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.087660 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.087802 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:18.087891 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:28:18.087950 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.087981 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.087997 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:28:18.089761 4382 raft_consensus.cc:1261] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Refusing update from remote peer c538f733c6024693ac3223ac69e2e3a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:18.089798 4237 raft_consensus.cc:1261] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Refusing update from remote peer c538f733c6024693ac3223ac69e2e3a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:18.090109 4460 consensus_queue.cc:1035] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:18.090265 4465 consensus_queue.cc:1035] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:18.093008 4470 mvcc.cc:205] Tried to move back new op lower bound from 7317334008173142016 to 7317334008125108224. Current Snapshot: MvccSnapshot[applied={T|T < 7317334008173142016}]
I20260811 14:28:18.093389 4469 mvcc.cc:205] Tried to move back new op lower bound from 7317334008173142016 to 7317334008125108224. Current Snapshot: MvccSnapshot[applied={T|T < 7317334008173142016}]
I20260811 14:28:18.093732 4468 mvcc.cc:205] Tried to move back new op lower bound from 7317334008173142016 to 7317334008125108224. Current Snapshot: MvccSnapshot[applied={T|T < 7317334008173142016 or (T in {7317334008173142016})}]
I20260811 14:28:18.095013 3937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:18.095108 3937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:18.095839 3937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Sending DeleteTablet for 3 replicas of tablet 7923d66893f9419796f04bcec5b53be0
I20260811 14:28:18.096207 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4005
I20260811 14:28:18.096230 4071 tablet_service.cc:1514] Processing DeleteTablet for tablet 7923d66893f9419796f04bcec5b53be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:52456
I20260811 14:28:18.096226 4216 tablet_service.cc:1514] Processing DeleteTablet for tablet 7923d66893f9419796f04bcec5b53be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:60320
I20260811 14:28:18.099402 4361 tablet_service.cc:1514] Processing DeleteTablet for tablet 7923d66893f9419796f04bcec5b53be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:59828
I20260811 14:28:18.099737 4479 tablet_replica.cc:330] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: stopping tablet replica
I20260811 14:28:18.099860 4479 raft_consensus.cc:2229] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:18.099978 4479 raft_consensus.cc:2258] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:18.100391 4479 ts_tablet_manager.cc:1905] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:18.102169 4479 ts_tablet_manager.cc:1918] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:18.102254 4479 log.cc:1196] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/7923d66893f9419796f04bcec5b53be0
I20260811 14:28:18.102506 4479 ts_tablet_manager.cc:1939] T 7923d66893f9419796f04bcec5b53be0 P 95f4963bd9704e87afa8330e46231959: Deleting consensus metadata
I20260811 14:28:18.102912 3920 catalog_manager.cc:4841] TS 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): tablet 7923d66893f9419796f04bcec5b53be0 (table test-table [id=cb050dba533e4abb918cc2841e4b8c7f]) successfully deleted
W20260811 14:28:18.103715 3922 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:45253 (error 108)
I20260811 14:28:18.103989 4478 tablet_replica.cc:330] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: stopping tablet replica
I20260811 14:28:18.104104 4478 raft_consensus.cc:2229] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:18.104220 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.104061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45253 (local address 127.0.0.1:52470)
0811 14:28:18.104109 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.104190 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 14:28:18.104236 4478 raft_consensus.cc:2258] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 14:28:18.104334 3922 catalog_manager.cc:4584] TS c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7923d66893f9419796f04bcec5b53be0: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45253: connect: Connection refused (error 111)
I20260811 14:28:18.104431 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4149
I20260811 14:28:18.117067 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4291
I20260811 14:28:18.117100 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.116936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39621 (local address 127.0.0.1:60332)
0811 14:28:18.117015 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.117051 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.194:39621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 14:28:18.122623 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 3904
I20260811 14:28:18.129655 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37175
--webserver_interface=127.20.132.254
--webserver_port=41017
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:18.211759 4481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:18.212001 4481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:18.212038 4481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:18.213233 4481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:18.213300 4481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:18.213325 4481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:18.213353 4481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:18.213394 4481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:18.214879 4481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=41017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:18.215154 4481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:18.215386 4481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:18.224598 4491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.224540 4487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.224689 4481 server_base.cc:1034] running on GCE node
W20260811 14:28:18.224637 4489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.225091 4481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:18.225412 4481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:18.226554 4481 hybrid_clock.cc:648] HybridClock initialized: now 1786458498226546 us; error 28 us; skew 500 ppm
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:18.238463 4481 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:18.238888 4481 webserver.cc:460] Webserver started at http://127.20.132.254:41017/ using document root <none> and password file <none>
I20260811 14:28:18.239092 4481 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:18.239142 4481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:18.240582 4481 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:18.241206 4499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.241379 4481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:18.241488 4481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f5e9645a666ab912a61e7b8cfa23b906"
server_key_iv: "104529f689093c77ae4e5e4e8abed66c"
server_key_version: "encryptionkey@0"
I20260811 14:28:18.241915 4481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:18.254092 4481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:18.256454 4481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:18.256610 4481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:18.260725 4481 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37175
I20260811 14:28:18.260756 4557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37175 every 8 connection(s)
I20260811 14:28:18.261170 4481 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:18.262863 4558 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:28:18.263515 4558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap starting.
I20260811 14:28:18.264599 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4481
I20260811 14:28:18.264904 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:45253
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:37175
--webserver_port=37453
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:18.272794 4558 log.cc:824] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:18.274685 4558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:18.274979 4558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap complete.
I20260811 14:28:18.277328 4558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.277598 4558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cddf99fe5384aeda09fb7cf0d54c1c2, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.277801 4558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.277900 4558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:18.277957 4558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:18.278005 4558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:28:18.278990 4558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.279106 4558 leader_election.cc:302] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cddf99fe5384aeda09fb7cf0d54c1c2; no voters:
I20260811 14:28:18.279309 4558 leader_election.cc:288] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 14:28:18.279345 4562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:28:18.279507 4562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 LEADER]: Becoming Leader. State: Replica: 8cddf99fe5384aeda09fb7cf0d54c1c2, State: Running, Role: LEADER
I20260811 14:28:18.279574 4558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:18.279652 4562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.280011 4563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } } }
I20260811 14:28:18.280100 4563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:18.280361 4564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cddf99fe5384aeda09fb7cf0d54c1c2. Latest consensus state: current_term: 2 leader_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } } }
I20260811 14:28:18.280436 4564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:18.280539 4572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:18.281411 4572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:18.281523 4572 catalog_manager.cc:1259] Loaded cluster ID: aea28581fa614f4ebae1878f5aab1dc3
I20260811 14:28:18.281612 4572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:18.282063 4572 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 14:28:18.284796 4572 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 14:28:18.286633 4572 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:18.286845 4572 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Loaded TSK: 0
I20260811 14:28:18.287053 4572 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:28:18.361994 4560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:18.362217 4560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:18.362254 4560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:18.363360 4560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:18.363426 4560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:18.363471 4560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:18.364960 4560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:45253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=37453
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:18.365218 4560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:18.365442 4560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:18.371366 4591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.371399 4560 server_base.cc:1034] running on GCE node
W20260811 14:28:18.371381 4590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.371544 4593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.371764 4560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:18.372001 4560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:18.373163 4560 hybrid_clock.cc:648] HybridClock initialized: now 1786458498373150 us; error 39 us; skew 500 ppm
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:18.375651 4560 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:18.376091 4560 webserver.cc:460] Webserver started at http://127.20.132.193:37453/ using document root <none> and password file <none>
I20260811 14:28:18.376353 4560 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:18.376447 4560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:18.377847 4560 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:18.378607 4601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.378800 4560 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:18.378899 4560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "c538f733c6024693ac3223ac69e2e3a4"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f7e4888524f7e4b616d1fddd116170a0"
server_key_iv: "4748e766df19676c10909ab58c03bc9f"
server_key_version: "encryptionkey@0"
I20260811 14:28:18.379299 4560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:18.414243 4560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:18.416605 4560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:18.416776 4560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:18.417023 4560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:18.417549 4609 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 14:28:18.419051 4560 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 14:28:18.419103 4560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 14:28:18.419138 4560 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 14:28:18.419806 4560 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 14:28:18.419852 4560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:18.419893 4609 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Bootstrap starting.
I20260811 14:28:18.427969 4560 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:45253
I20260811 14:28:18.428064 4725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:45253 every 8 connection(s)
I20260811 14:28:18.428467 4560 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:28:18.431253 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4560
I20260811 14:28:18.431589 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:39621
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:37175
--webserver_port=44507
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:18.432297 4609 log.cc:824] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:18.434746 4609 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:18.435031 4609 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Bootstrap complete.
I20260811 14:28:18.436014 4609 ts_tablet_manager.cc:1397] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:18.441208 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.429326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:57471 (local address 127.20.132.254:37175)
0811 14:28:18.429488 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.429497 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.429537 (+ 40us) server_negotiation.cc:407] Connection header received
0811 14:28:18.430388 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.430393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.430436 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.430549 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:18.431514 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.432919 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.434409 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.434805 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.434926 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.437708 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:18.437716 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:18.437716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:18.437727 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:18.439386 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.439820 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.439823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.439824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.439921 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.440243 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.440244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.440244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.440466 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:18.440605 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.440895 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.441021 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260811 14:28:18.441231 4729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.429170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:57471)
0811 14:28:18.429376 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.429438 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.430153 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.430632 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.430637 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.431045 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:18.431388 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.431396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.433041 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.433043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.434310 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.434312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.435030 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.435031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.435185 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.436084 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:18.436093 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:18.437594 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:18.439485 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.439492 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.439494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.439719 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.440021 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.440022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.440023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.440183 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.440582 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:18.440589 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:18.440727 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.440837 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.441015 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":118,"threads_started":1}
I20260811 14:28:18.441879 4726 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37175
I20260811 14:28:18.441998 4726 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:18.442178 4726 heartbeater.cc:511] Master 127.20.132.254:37175 requested a full tablet report, sending...
I20260811 14:28:18.442919 4516 ts_manager.cc:194] Registered new tserver with Master: c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253)
I20260811 14:28:18.443367 4609 raft_consensus.cc:348] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.443753 4609 raft_consensus.cc:729] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538f733c6024693ac3223ac69e2e3a4, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.443933 4609 consensus_queue.cc:260] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.444084 4516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:57471
I20260811 14:28:18.444295 4609 ts_tablet_manager.cc:1428] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260811 14:28:18.445154 4726 heartbeater.cc:503] Master 127.20.132.254:37175 was elected leader, sending a full tablet report...
I20260811 14:28:18.448482 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.443513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45253 (local address 127.0.0.1:38514)
0811 14:28:18.444751 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.444793 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.444873 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.445124 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.445127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.445137 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:18.445204 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.445206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.446532 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.446533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.447361 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.447364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.448254 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.448255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.448318 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.448328 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.448382 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.448429 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1204,"thread_start_us":76,"threads_started":1}
I20260811 14:28:18.448516 4736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.444447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38514 (local address 127.20.132.193:45253)
0811 14:28:18.444596 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.444600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.444873 (+ 273us) server_negotiation.cc:407] Connection header received
0811 14:28:18.445005 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.445008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.445022 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.445091 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:18.445322 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.446429 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.447443 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.448155 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.448232 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.448284 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.448412 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.448451 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260811 14:28:18.448921 4657 tablet_service.cc:1514] Processing DeleteTablet for tablet 7923d66893f9419796f04bcec5b53be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:38514
I20260811 14:28:18.449488 4737 tablet_replica.cc:330] stopping tablet replica
I20260811 14:28:18.449592 4737 raft_consensus.cc:2229] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:18.449657 4737 raft_consensus.cc:2258] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:18.449944 4737 ts_tablet_manager.cc:1905] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:18.452060 4737 ts_tablet_manager.cc:1918] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:18.452255 4737 log.cc:1196] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/7923d66893f9419796f04bcec5b53be0
I20260811 14:28:18.452518 4737 ts_tablet_manager.cc:1939] T 7923d66893f9419796f04bcec5b53be0 P c538f733c6024693ac3223ac69e2e3a4: Deleting consensus metadata
I20260811 14:28:18.453017 4502 catalog_manager.cc:4841] TS c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253): tablet 7923d66893f9419796f04bcec5b53be0 (table test-table [id=cb050dba533e4abb918cc2841e4b8c7f]) successfully deleted
W20260811 14:28:18.517890 4732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:18.518134 4732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:18.518172 4732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:18.519304 4732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:18.519371 4732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:18.519419 4732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:18.520953 4732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:39621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=44507
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:18.521222 4732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:18.521448 4732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:18.526443 4745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.526485 4744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.526589 4747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.526826 4732 server_base.cc:1034] running on GCE node
I20260811 14:28:18.527035 4732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:18.527318 4732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:18.528491 4732 hybrid_clock.cc:648] HybridClock initialized: now 1786458498528459 us; error 48 us; skew 500 ppm
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:18.530930 4732 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:18.531368 4732 webserver.cc:460] Webserver started at http://127.20.132.194:44507/ using document root <none> and password file <none>
I20260811 14:28:18.531621 4732 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:18.531710 4732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:18.533102 4732 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:18.533772 4757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.533946 4732 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:18.534052 4732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "79c263cfb36d84a242deb9e676745b2c"
server_key_iv: "5c4ae3f47597c5c8f99bf5290c4932f8"
server_key_version: "encryptionkey@0"
I20260811 14:28:18.534409 4732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:18.545462 4732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:18.547492 4732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:18.547669 4732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:18.547914 4732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:18.548418 4765 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 14:28:18.550019 4732 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 14:28:18.550089 4732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 14:28:18.550135 4732 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 14:28:18.550770 4732 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 14:28:18.550828 4732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:18.550879 4765 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Bootstrap starting.
I20260811 14:28:18.557430 4732 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:39621
I20260811 14:28:18.557507 4880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:39621 every 8 connection(s)
I20260811 14:28:18.557832 4732 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:18.559206 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4732
I20260811 14:28:18.559525 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:35829
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:37175
--webserver_port=46389
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:18.561585 4765 log.cc:824] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:18.563959 4765 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:18.564425 4765 tablet_bootstrap.cc:492] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Bootstrap complete.
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:18.565788 4765 ts_tablet_manager.cc:1397] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.011s
I20260811 14:28:18.567376 4765 raft_consensus.cc:348] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.567766 4765 raft_consensus.cc:729] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d66e5ba5d348998d2d4d07cbb84e89, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.567986 4765 consensus_queue.cc:260] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } } peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } }
I20260811 14:28:18.568349 4765 ts_tablet_manager.cc:1428] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
I20260811 14:28:18.569464 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.558662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:52157 (local address 127.20.132.254:37175)
0811 14:28:18.558742 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.558745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.558888 (+ 143us) server_negotiation.cc:407] Connection header received
0811 14:28:18.559362 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.559364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.559377 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.559441 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:18.560069 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.560739 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.562254 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.562601 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.562642 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.565803 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:18.565805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:18.565806 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:18.565815 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:18.567742 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.568328 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.568329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.568330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.568398 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.568728 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.568729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.568730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.568866 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:18.568958 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.569255 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.569366 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:28:18.569649 4883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.558552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:52157)
0811 14:28:18.558752 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.558795 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.559249 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.559500 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.559504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.559779 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:18.559964 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.559969 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.560864 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.560869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.562139 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.562143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.562740 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.562741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.562845 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.563429 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:18.563440 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:18.565673 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:18.567854 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.567860 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.567862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.568223 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.568485 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.568486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.568487 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.568637 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.568959 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:18.568968 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:18.569110 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.569231 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.569410 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":124,"threads_started":1}
I20260811 14:28:18.570220 4881 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37175
I20260811 14:28:18.570339 4881 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:18.570523 4881 heartbeater.cc:511] Master 127.20.132.254:37175 requested a full tablet report, sending...
I20260811 14:28:18.571157 4516 ts_manager.cc:194] Registered new tserver with Master: 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
I20260811 14:28:18.571797 4516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:52157
I20260811 14:28:18.572702 4881 heartbeater.cc:503] Master 127.20.132.254:37175 was elected leader, sending a full tablet report...
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.194@KRBTEST.COM
I20260811 14:28:18.579670 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.571498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39621 (local address 127.0.0.1:41950)
0811 14:28:18.571545 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.571557 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.571618 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.571896 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.571897 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.572313 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:18.572355 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.572358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.573506 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.573507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.574063 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.574065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.574612 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.574613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.574682 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.575222 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:18.575226 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:18.576675 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:18.578409 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.578418 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.578420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.578638 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.578902 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.578903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.578903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.578972 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.579281 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:18.579289 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:18.579343 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.579445 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.579553 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 14:28:18.579756 4887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.571568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41950 (local address 127.20.132.194:39621)
0811 14:28:18.571722 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.571727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.571737 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:28:18.571776 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.571778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.571789 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.571874 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:18.572459 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.573402 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.574172 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.574503 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.574608 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.576771 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:18.576780 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:18.576780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:18.576787 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:18.578298 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.578746 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.578749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.578749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.578815 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.579048 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.579050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.579050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.579201 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:18.579302 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.579485 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.579650 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260811 14:28:18.580191 4811 tablet_service.cc:1514] Processing DeleteTablet for tablet 7923d66893f9419796f04bcec5b53be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:41950
I20260811 14:28:18.580857 4888 tablet_replica.cc:330] stopping tablet replica
I20260811 14:28:18.580967 4888 raft_consensus.cc:2229] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:18.581033 4888 raft_consensus.cc:2258] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:18.581355 4888 ts_tablet_manager.cc:1905] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:18.583920 4888 ts_tablet_manager.cc:1918] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:18.584002 4888 log.cc:1196] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/7923d66893f9419796f04bcec5b53be0
I20260811 14:28:18.584390 4888 ts_tablet_manager.cc:1939] T 7923d66893f9419796f04bcec5b53be0 P 84d66e5ba5d348998d2d4d07cbb84e89: Deleting consensus metadata
I20260811 14:28:18.585075 4500 catalog_manager.cc:4841] TS 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): tablet 7923d66893f9419796f04bcec5b53be0 (table test-table [id=cb050dba533e4abb918cc2841e4b8c7f]) successfully deleted
W20260811 14:28:18.651714 4884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:18.651981 4884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:18.652014 4884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:18.653230 4884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:18.653275 4884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:18.653328 4884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:18.654820 4884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:35829
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=46389
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:18.655071 4884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:18.655356 4884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:18.660476 4897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.660473 4894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.660530 4895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.660746 4884 server_base.cc:1034] running on GCE node
I20260811 14:28:18.660985 4884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:18.661249 4884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:18.662400 4884 hybrid_clock.cc:648] HybridClock initialized: now 1786458498662380 us; error 35 us; skew 500 ppm
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:18.664927 4884 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:18.665395 4884 webserver.cc:460] Webserver started at http://127.20.132.195:46389/ using document root <none> and password file <none>
I20260811 14:28:18.665632 4884 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:18.665714 4884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:18.667081 4884 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:18.667660 4905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.667829 4884 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:28:18.667928 4884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "95f4963bd9704e87afa8330e46231959"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "bf2fddbccd69573da89b0210f7fcd76a"
server_key_iv: "28a0d16c065501aedeef472b108159f6"
server_key_version: "encryptionkey@0"
I20260811 14:28:18.668326 4884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:18.682394 4884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:18.684432 4884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:18.684587 4884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:18.684816 4884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:18.685118 4884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:18.685177 4884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.685218 4884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:18.685246 4884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.691128 4884 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:35829
I20260811 14:28:18.691177 5031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:35829 every 8 connection(s)
I20260811 14:28:18.691501 4884 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:18.700023 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.692190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:50223 (local address 127.20.132.254:37175)
0811 14:28:18.692255 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.692258 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.692513 (+ 255us) server_negotiation.cc:407] Connection header received
0811 14:28:18.692977 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.692978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.692988 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.693041 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:18.693924 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.694405 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.695335 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.695523 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.695579 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.697669 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:18.697670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:18.697670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:18.697683 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:18.698861 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.699226 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.699227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.699228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.699273 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.699474 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.699475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.699475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.699580 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:18.699629 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.699845 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.699907 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 14:28:18.700172 5034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.692203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:50223)
0811 14:28:18.692386 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.692422 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.692892 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.693093 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.693102 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.693652 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:18.693835 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.693839 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.694485 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.694486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.695251 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.695253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.695598 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.695599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.695695 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.696191 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:18.696200 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:18.697585 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:18.698931 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.698936 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.698938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.699162 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.699330 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:18.699331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:18.699331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:18.699422 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:18.699634 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:18.699638 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:18.699740 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.699818 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.699945 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260811 14:28:18.700165 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 4884
I20260811 14:28:18.700783 5032 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37175
I20260811 14:28:18.700892 5032 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:18.701086 5032 heartbeater.cc:511] Master 127.20.132.254:37175 requested a full tablet report, sending...
I20260811 14:28:18.701472 4516 ts_manager.cc:194] Registered new tserver with Master: 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829)
I20260811 14:28:18.701973 4516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:50223
I20260811 14:28:18.706661 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.700551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40432 (local address 127.20.132.254:37175)
0811 14:28:18.700582 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.700584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.700737 (+ 153us) server_negotiation.cc:407] Connection header received
0811 14:28:18.700813 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.700813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.700823 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.700879 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:18.701635 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.702256 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.703318 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.703489 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.703545 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.704642 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:18.704643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:18.704643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:18.704649 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:18.705779 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.706074 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.706074 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.706075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.706123 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:18.706280 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:18.706281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:18.706281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:18.706367 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:18.706484 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.706517 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.706570 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 14:28:18.707448 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:28:18.710294 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.707794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40448 (local address 127.20.132.254:37175)
0811 14:28:18.707829 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.707831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.707977 (+ 146us) server_negotiation.cc:407] Connection header received
0811 14:28:18.708060 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.708066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.708110 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.708212 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:18.708352 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.708799 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.709529 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.709726 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.709798 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.709973 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:18.710068 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:28:18.710156 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.710206 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.710222 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:28:18.710608 4516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:28:18.712278 4516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:28:18.714520 4657 tablet_service.cc:1467] Processing CreateTablet for tablet 530d73d29bb5469594f51d66cef9205d (DEFAULT_TABLE table=test-table [id=6e391311d19c4c248f04fc2ac012a43c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:18.714560 4811 tablet_service.cc:1467] Processing CreateTablet for tablet 530d73d29bb5469594f51d66cef9205d (DEFAULT_TABLE table=test-table [id=6e391311d19c4c248f04fc2ac012a43c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:18.714732 4657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530d73d29bb5469594f51d66cef9205d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:18.714777 4811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530d73d29bb5469594f51d66cef9205d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:18.716166 4609 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Bootstrap starting.
I20260811 14:28:18.716370 4765 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Bootstrap starting.
I20260811 14:28:18.716527 4609 tablet_bootstrap.cc:654] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:18.716643 4765 tablet_bootstrap.cc:654] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:18.717110 4609 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: No bootstrap required, opened a new log
I20260811 14:28:18.717176 4609 ts_tablet_manager.cc:1397] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:18.717276 4609 raft_consensus.cc:348] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.717345 4609 raft_consensus.cc:374] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:18.717393 4609 raft_consensus.cc:729] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538f733c6024693ac3223ac69e2e3a4, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.717442 4609 consensus_queue.cc:260] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.717531 4609 ts_tablet_manager.cc:1428] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.717893 4765 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: No bootstrap required, opened a new log
I20260811 14:28:18.717964 4765 ts_tablet_manager.cc:1397] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:28:18.718369 4765 raft_consensus.cc:348] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.718453 4765 raft_consensus.cc:374] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:18.718508 4765 raft_consensus.cc:729] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d66e5ba5d348998d2d4d07cbb84e89, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.718556 4765 consensus_queue.cc:260] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.718619 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.714224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35829 (local address 127.0.0.1:51614)
0811 14:28:18.714275 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.714287 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.714325 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.714815 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.714816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.714818 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:18.714863 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.714864 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.716411 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.716412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.717514 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.717518 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.718367 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.718368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.718435 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.718439 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.718502 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.718549 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:28:18.718657 4765 ts_tablet_manager.cc:1428] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:18.718729 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.714408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51614 (local address 127.20.132.195:35829)
0811 14:28:18.714622 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.714627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.714637 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:28:18.714680 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.714682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.714698 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.714942 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:18.715013 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.716251 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.717617 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.718284 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.718346 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.718384 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.718529 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.718573 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":114,"threads_started":1}
I20260811 14:28:18.719403 4961 tablet_service.cc:1467] Processing CreateTablet for tablet 530d73d29bb5469594f51d66cef9205d (DEFAULT_TABLE table=test-table [id=6e391311d19c4c248f04fc2ac012a43c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:18.719769 4961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530d73d29bb5469594f51d66cef9205d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:18.722591 5044 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Bootstrap starting.
I20260811 14:28:18.723197 5044 tablet_bootstrap.cc:654] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:18.723685 5044 log.cc:824] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:18.724543 5044 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: No bootstrap required, opened a new log
I20260811 14:28:18.724599 5044 ts_tablet_manager.cc:1397] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:28:18.725872 5044 raft_consensus.cc:348] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.725997 5044 raft_consensus.cc:374] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:18.726018 5044 raft_consensus.cc:729] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f4963bd9704e87afa8330e46231959, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.726131 5044 consensus_queue.cc:260] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.726368 5044 ts_tablet_manager.cc:1428] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:28:18.726413 5032 heartbeater.cc:503] Master 127.20.132.254:37175 was elected leader, sending a full tablet report...
I20260811 14:28:18.749442 5047 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:18.749600 5047 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.749979 5047 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621), c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253)
I20260811 14:28:18.753029 5034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.750122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39621 (local address 127.20.132.195:46571)
0811 14:28:18.750193 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.750209 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.750258 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.750436 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.750437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.750438 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:18.750511 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.750513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.751371 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.751372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.752096 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.752098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.752775 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.752776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.752849 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.752852 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.752916 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.752956 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 14:28:18.753029 4887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.750205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:46571 (local address 127.20.132.194:39621)
0811 14:28:18.750291 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.750294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.750303 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:18.750333 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.750334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.750363 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.750421 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:18.750592 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.751301 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.752247 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.752683 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.752781 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.752861 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.752922 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.752964 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 14:28:18.753244 4736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.750284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:49973 (local address 127.20.132.193:45253)
0811 14:28:18.750353 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.750355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.750452 (+ 97us) server_negotiation.cc:407] Connection header received
0811 14:28:18.750533 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.750535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.750544 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.750617 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:18.750789 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.751455 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.752456 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.752833 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.752929 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.752938 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.753095 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.753159 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:28:18.753408 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.750190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45253 (local address 127.20.132.195:49973)
0811 14:28:18.750364 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.750374 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:18.750466 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:18.750619 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:18.750620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:18.750622 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:18.750707 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.750713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.751537 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.751538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.752372 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:18.752374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.752932 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.752933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:18.753010 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.753013 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:18.753220 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 14:28:18.753258 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":117,"threads_started":1}
I20260811 14:28:18.753356 4833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530d73d29bb5469594f51d66cef9205d" candidate_uuid: "95f4963bd9704e87afa8330e46231959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" is_pre_election: true
I20260811 14:28:18.753540 4833 raft_consensus.cc:2454] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f4963bd9704e87afa8330e46231959 in term 0.
I20260811 14:28:18.753798 4906 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959; no voters:
I20260811 14:28:18.753944 5047 raft_consensus.cc:2781] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:28:18.754000 5047 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:28:18.754027 5047 raft_consensus.cc:3037] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:18.754104 4679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530d73d29bb5469594f51d66cef9205d" candidate_uuid: "95f4963bd9704e87afa8330e46231959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538f733c6024693ac3223ac69e2e3a4" is_pre_election: true
I20260811 14:28:18.754261 4679 raft_consensus.cc:2454] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f4963bd9704e87afa8330e46231959 in term 0.
I20260811 14:28:18.754848 5047 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.754987 5047 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [CANDIDATE]: Term 1 election: Requested vote from peers 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621), c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253)
I20260811 14:28:18.755105 4833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530d73d29bb5469594f51d66cef9205d" candidate_uuid: "95f4963bd9704e87afa8330e46231959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
I20260811 14:28:18.755144 4679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530d73d29bb5469594f51d66cef9205d" candidate_uuid: "95f4963bd9704e87afa8330e46231959" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538f733c6024693ac3223ac69e2e3a4"
I20260811 14:28:18.755193 4833 raft_consensus.cc:3037] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:18.755266 4679 raft_consensus.cc:3037] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:18.755879 4833 raft_consensus.cc:2454] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f4963bd9704e87afa8330e46231959 in term 1.
I20260811 14:28:18.756039 4906 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959; no voters:
I20260811 14:28:18.756112 4679 raft_consensus.cc:2454] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f4963bd9704e87afa8330e46231959 in term 1.
I20260811 14:28:18.756183 5047 raft_consensus.cc:2781] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:18.756345 5047 raft_consensus.cc:686] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 1 LEADER]: Becoming Leader. State: Replica: 95f4963bd9704e87afa8330e46231959, State: Running, Role: LEADER
I20260811 14:28:18.756445 5047 consensus_queue.cc:237] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:18.757267 4516 catalog_manager.cc:5495] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95f4963bd9704e87afa8330e46231959 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "95f4963bd9704e87afa8330e46231959" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } health_report { overall_health: UNKNOWN } } }
I20260811 14:28:18.764678 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.762577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.20.132.195:35829)
0811 14:28:18.762627 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:18.762628 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:18.762636 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:28:18.762710 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:18.762711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:18.762725 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:18.762785 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:18.762864 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.763292 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.763943 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:18.764119 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:18.764249 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:18.764365 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:18.764451 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:28:18.764507 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:18.764545 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 14:28:18.764561 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:28:18.766361 4679 raft_consensus.cc:1261] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Refusing update from remote peer 95f4963bd9704e87afa8330e46231959: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:18.766372 4833 raft_consensus.cc:1261] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Refusing update from remote peer 95f4963bd9704e87afa8330e46231959: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:18.766657 5047 consensus_queue.cc:1035] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:18.766824 5049 consensus_queue.cc:1035] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:18.768661 5052 mvcc.cc:205] Tried to move back new op lower bound from 7317334010944561152 to 7317334010907111424. Current Snapshot: MvccSnapshot[applied={T|T < 7317334010944561152}]
I20260811 14:28:18.769162 5053 mvcc.cc:205] Tried to move back new op lower bound from 7317334010944561152 to 7317334010907111424. Current Snapshot: MvccSnapshot[applied={T|T < 7317334010944561152}]
I20260811 14:28:18.769002 5054 mvcc.cc:205] Tried to move back new op lower bound from 7317334010944561152 to 7317334010907111424. Current Snapshot: MvccSnapshot[applied={T|T < 7317334010944561152}]
I20260811 14:28:18.771636 4516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:18.771766 4516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:18.772544 4516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Sending DeleteTablet for 3 replicas of tablet 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:18.772842 4657 tablet_service.cc:1514] Processing DeleteTablet for tablet 530d73d29bb5469594f51d66cef9205d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:38514
I20260811 14:28:18.772833 4961 tablet_service.cc:1514] Processing DeleteTablet for tablet 530d73d29bb5469594f51d66cef9205d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:51614
I20260811 14:28:18.772891 4811 tablet_service.cc:1514] Processing DeleteTablet for tablet 530d73d29bb5469594f51d66cef9205d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:18 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:41950
I20260811 14:28:18.773000 4737 tablet_replica.cc:330] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: stopping tablet replica
I20260811 14:28:18.773064 4737 raft_consensus.cc:2229] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:18.773075 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4560
I20260811 14:28:18.773125 4737 raft_consensus.cc:2258] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:18.773211 4888 tablet_replica.cc:330] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: stopping tablet replica
I20260811 14:28:18.773257 4888 raft_consensus.cc:2229] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:18.773295 4888 raft_consensus.cc:2258] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:18.776592 4888 ts_tablet_manager.cc:1905] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:18.778330 4888 ts_tablet_manager.cc:1918] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:18.778399 4888 log.cc:1196] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/530d73d29bb5469594f51d66cef9205d
I20260811 14:28:18.778635 4888 ts_tablet_manager.cc:1939] T 530d73d29bb5469594f51d66cef9205d P 84d66e5ba5d348998d2d4d07cbb84e89: Deleting consensus metadata
I20260811 14:28:18.778980 4500 catalog_manager.cc:4841] TS 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): tablet 530d73d29bb5469594f51d66cef9205d (table test-table [id=6e391311d19c4c248f04fc2ac012a43c]) successfully deleted
W20260811 14:28:18.782091 4502 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:45253 (error 108)
I20260811 14:28:18.782326 5062 tablet_replica.cc:330] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: stopping tablet replica
I20260811 14:28:18.782444 5062 raft_consensus.cc:2229] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:28:18.782581 5062 raft_consensus.cc:2258] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:18.782598 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:18.782453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:45253 (local address 127.0.0.1:38526)
0811 14:28:18.782497 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:18.782545 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 14:28:18.782732 4502 catalog_manager.cc:4584] TS c538f733c6024693ac3223ac69e2e3a4 (127.20.132.193:45253): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 530d73d29bb5469594f51d66cef9205d: Network error: Client connection negotiation failed: client connection to 127.20.132.193:45253: connect: Connection refused (error 111)
I20260811 14:28:18.783421 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4732
I20260811 14:28:18.783458 5062 ts_tablet_manager.cc:1905] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:18.791107 5062 ts_tablet_manager.cc:1918] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:18.791201 5062 log.cc:1196] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/530d73d29bb5469594f51d66cef9205d
I20260811 14:28:18.791495 5062 ts_tablet_manager.cc:1939] T 530d73d29bb5469594f51d66cef9205d P 95f4963bd9704e87afa8330e46231959: Deleting consensus metadata
I20260811 14:28:18.791905 4500 catalog_manager.cc:4841] TS 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): tablet 530d73d29bb5469594f51d66cef9205d (table test-table [id=6e391311d19c4c248f04fc2ac012a43c]) successfully deleted
I20260811 14:28:18.796458 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4884
I20260811 14:28:18.803062 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 4481
I20260811 14:28:18.810182 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37175
--webserver_interface=127.20.132.254
--webserver_port=41017
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:18.892536 5064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:18.892750 5064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:18.892772 5064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:18.893929 5064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:18.893970 5064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:18.893985 5064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:18.894021 5064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:18.894047 5064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:18.895593 5064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=41017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:18.895846 5064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:18.896085 5064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:18.901000 5069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.901031 5070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:18.901021 5072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:18.901180 5064 server_base.cc:1034] running on GCE node
I20260811 14:28:18.901482 5064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:18.901832 5064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:18.903007 5064 hybrid_clock.cc:648] HybridClock initialized: now 1786458498903007 us; error 44 us; skew 500 ppm
Aug 11 14:28:18 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458498, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:18.905588 5064 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:18.906049 5064 webserver.cc:460] Webserver started at http://127.20.132.254:41017/ using document root <none> and password file <none>
I20260811 14:28:18.906378 5064 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:18.906477 5064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:18.907843 5064 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:18.908584 5080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.908756 5064 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:18.908856 5064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f5e9645a666ab912a61e7b8cfa23b906"
server_key_iv: "104529f689093c77ae4e5e4e8abed66c"
server_key_version: "encryptionkey@0"
I20260811 14:28:18.909185 5064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:18.924247 5064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:18.926422 5064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:18.926595 5064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:18.930778 5064 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37175
I20260811 14:28:18.930833 5140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37175 every 8 connection(s)
I20260811 14:28:18.931237 5064 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:18.932847 5141 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:28:18.933523 5141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap starting.
I20260811 14:28:18.935388 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5064
I20260811 14:28:18.935734 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:45253
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:37175
--webserver_port=37453
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:18.943598 5141 log.cc:824] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:18.947299 5141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:18.947685 5141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2: Bootstrap complete.
I20260811 14:28:18.951088 5141 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.951406 5141 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cddf99fe5384aeda09fb7cf0d54c1c2, State: Initialized, Role: FOLLOWER
I20260811 14:28:18.951562 5141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.951633 5141 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:18.951678 5141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:18.951726 5141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 2 FOLLOWER]: Advancing to term 3
I20260811 14:28:18.953107 5141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.953218 5141 leader_election.cc:302] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cddf99fe5384aeda09fb7cf0d54c1c2; no voters:
I20260811 14:28:18.953382 5141 leader_election.cc:288] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 14:28:18.953475 5146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 14:28:18.953632 5141 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:18.953650 5146 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [term 3 LEADER]: Becoming Leader. State: Replica: 8cddf99fe5384aeda09fb7cf0d54c1c2, State: Running, Role: LEADER
I20260811 14:28:18.953776 5146 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } }
I20260811 14:28:18.954160 5147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } } }
I20260811 14:28:18.954249 5147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:18.954509 5148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cddf99fe5384aeda09fb7cf0d54c1c2. Latest consensus state: current_term: 3 leader_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cddf99fe5384aeda09fb7cf0d54c1c2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37175 } } }
I20260811 14:28:18.954679 5148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cddf99fe5384aeda09fb7cf0d54c1c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:18.954720 5155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:18.955534 5155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:18.955749 5155 catalog_manager.cc:1259] Loaded cluster ID: aea28581fa614f4ebae1878f5aab1dc3
I20260811 14:28:18.955796 5155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 14:28:18.956132 5155 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fce05f789ad google::LogMessage::Fail() at ??:0
@ 0x7fce05f7b88a google::LogMessage::SendToLog() at ??:0
@ 0x7fce05f784de google::LogMessage::Flush() at ??:0
@ 0x7fce05f79a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fce0de990f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fce0dea28b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fce07e460d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fce07e3b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fce08c9f6db start_thread at ??:0
@ 0x7fce04a7661f clone at ??:0
W20260811 14:28:19.060726 5144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:19.061053 5144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:19.061101 5144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:19.063035 5144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:19.063107 5144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:19.063154 5144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:19.065595 5144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:45253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=37453
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:19.065883 5144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:19.066187 5144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:19.071820 5181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:19.071810 5179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:19.071810 5183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:19.072041 5144 server_base.cc:1034] running on GCE node
I20260811 14:28:19.072467 5144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:19.072769 5144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:19.073974 5144 hybrid_clock.cc:648] HybridClock initialized: now 1786458499073954 us; error 46 us; skew 500 ppm
Aug 11 14:28:19 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458499, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:19.077548 5144 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:19.078150 5144 webserver.cc:460] Webserver started at http://127.20.132.193:37453/ using document root <none> and password file <none>
I20260811 14:28:19.078445 5144 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:19.078536 5144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:19.080507 5144 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 14:28:19.081445 5192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.081665 5144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:19.081750 5144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "c538f733c6024693ac3223ac69e2e3a4"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "f7e4888524f7e4b616d1fddd116170a0"
server_key_iv: "4748e766df19676c10909ab58c03bc9f"
server_key_version: "encryptionkey@0"
I20260811 14:28:19.082190 5144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:19.105453 5144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:19.107831 5144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:19.107970 5144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:19.108270 5144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:19.108742 5201 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 14:28:19.111057 5144 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 14:28:19.111137 5144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260811 14:28:19.111289 5144 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 14:28:19.111961 5144 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 14:28:19.112036 5144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:19.112111 5201 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Bootstrap starting.
I20260811 14:28:19.119438 5144 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:45253
I20260811 14:28:19.119596 5321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:45253 every 8 connection(s)
I20260811 14:28:19.119877 5144 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:28:19.122745 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5144
I20260811 14:28:19.123064 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:39621
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:37175
--webserver_port=44507
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:19.125015 5201 log.cc:824] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:19.128186 5201 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:19.128575 5201 tablet_bootstrap.cc:492] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Bootstrap complete.
I20260811 14:28:19.130061 5201 ts_tablet_manager.cc:1397] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20260811 14:28:19.131852 5201 raft_consensus.cc:348] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:19.132266 5201 raft_consensus.cc:729] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538f733c6024693ac3223ac69e2e3a4, State: Initialized, Role: FOLLOWER
I20260811 14:28:19.132464 5201 consensus_queue.cc:260] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:19.132815 5201 ts_tablet_manager.cc:1428] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
W20260811 14:28:19.210486 5325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:19.210757 5325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:19.210801 5325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:19.212301 5325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:19.212374 5325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:19.212426 5325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:19.214491 5325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:39621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=44507
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:19.214798 5325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:19.215049 5325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:19.218024 5324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:28:19.120630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:43115)
0811 14:28:19.120818 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.120877 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:19.121313 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:19.217822 (+ 96509us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
W20260811 14:28:19.218322 5322 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:37175 (0 consecutive failures): Network error: Failed to ping master at 127.20.132.254:37175: Client connection negotiation failed: client connection to 127.20.132.254:37175: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 14:28:19.218748 5324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.218556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:60229)
0811 14:28:19.218669 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.218721 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 14:28:19.219125 5324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.219018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:56309)
0811 14:28:19.219071 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.219103 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:28:19.219273 5322 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:28:19.220747 5332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:19.220760 5333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:19.220759 5335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:19.220938 5325 server_base.cc:1034] running on GCE node
I20260811 14:28:19.221248 5325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:19.221498 5325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:19.222641 5325 hybrid_clock.cc:648] HybridClock initialized: now 1786458499222609 us; error 57 us; skew 500 ppm
Aug 11 14:28:19 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458499, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:19.225225 5325 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:19.225666 5325 webserver.cc:460] Webserver started at http://127.20.132.194:44507/ using document root <none> and password file <none>
I20260811 14:28:19.225899 5325 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:19.225946 5325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:19.227349 5325 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:19.228029 5344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.228323 5325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:19.228438 5325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "84d66e5ba5d348998d2d4d07cbb84e89"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "79c263cfb36d84a242deb9e676745b2c"
server_key_iv: "5c4ae3f47597c5c8f99bf5290c4932f8"
server_key_version: "encryptionkey@0"
I20260811 14:28:19.228802 5325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:19.246840 5325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:19.249006 5325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:19.249173 5325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:19.249436 5325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:19.249750 5325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:19.249806 5325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.249851 5325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:19.249876 5325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.255825 5325 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:39621
I20260811 14:28:19.255949 5472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:39621 every 8 connection(s)
I20260811 14:28:19.256367 5325 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:19.257450 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.257071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:52585)
0811 14:28:19.257219 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.257301 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
W20260811 14:28:19.257887 5473 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:37175 (0 consecutive failures): Network error: Failed to ping master at 127.20.132.254:37175: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
I20260811 14:28:19.258271 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.258172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:44617)
0811 14:28:19.258225 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.258253 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 14:28:19.258585 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.258508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:43885)
0811 14:28:19.258549 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.258570 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 14:28:19.258710 5473 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 14:28:19.261722 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5325
I20260811 14:28:19.262006 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:35829
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:37175
--webserver_port=46389
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:19.343281 5476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:19.343477 5476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:19.343501 5476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:19.344704 5476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:19.344746 5476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:19.344805 5476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:19.346304 5476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:35829
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=46389
--tserver_master_addrs=127.20.132.254:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:19.346540 5476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:19.346772 5476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:19.351823 5484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:19.351850 5481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:19.351904 5486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:19.352277 5476 server_base.cc:1034] running on GCE node
I20260811 14:28:19.352515 5476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:19.352787 5476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:19.353953 5476 hybrid_clock.cc:648] HybridClock initialized: now 1786458499353948 us; error 39 us; skew 500 ppm
Aug 11 14:28:19 dist-test-slave-cbbz krb5kdc[3889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458499, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:19.356429 5476 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:19.356909 5476 webserver.cc:460] Webserver started at http://127.20.132.195:46389/ using document root <none> and password file <none>
I20260811 14:28:19.357160 5476 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:19.357232 5476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:19.358578 5476 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:19.359167 5493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.359407 5476 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:19.359504 5476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "95f4963bd9704e87afa8330e46231959"
format_stamp: "Formatted at 2026-08-11 14:28:17 on dist-test-slave-cbbz"
server_key: "bf2fddbccd69573da89b0210f7fcd76a"
server_key_iv: "28a0d16c065501aedeef472b108159f6"
server_key_version: "encryptionkey@0"
I20260811 14:28:19.359840 5476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:19.371454 5476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:19.373337 5476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:19.373498 5476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:19.373725 5476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:19.374037 5476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:19.374091 5476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.374130 5476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:19.374157 5476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:19.380185 5476 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:35829
I20260811 14:28:19.380227 5617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:35829 every 8 connection(s)
I20260811 14:28:19.380551 5476 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:28:19.381503 5621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.381093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:35989)
0811 14:28:19.381236 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.381345 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
W20260811 14:28:19.381888 5619 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:37175 (0 consecutive failures): Network error: Failed to ping master at 127.20.132.254:37175: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
I20260811 14:28:19.382172 5621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.382084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:42641)
0811 14:28:19.382127 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.382155 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 14:28:19.382433 5621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:19.382362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:35915)
0811 14:28:19.382398 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:19.382419 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 14:28:19.382542 5619 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 14:28:19.387765 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5476
I20260811 14:28:20.219910 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.219648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:47267)
0811 14:28:20.219803 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:20.219843 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260811 14:28:20.259227 5626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.259017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:44379)
0811 14:28:20.259132 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:20.259174 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260811 14:28:20.383039 5627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.382844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:37571)
0811 14:28:20.382960 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:20.382994 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260811 14:28:20.938647 5628 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:20.938771 5628 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:20.939054 5628 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
Aug 11 14:28:20 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458499, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.195@KRBTEST.COM
Aug 11 14:28:20 dist-test-slave-cbbz krb5kdc[3889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458499, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.194@KRBTEST.COM
I20260811 14:28:20.949411 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.939255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:35829 (local address 127.20.132.193:51993)
0811 14:28:20.939391 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:20.939402 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:20.939461 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:20.940373 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:20.940376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:20.940803 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:20.940989 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:20.940995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.942103 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.942104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:20.942877 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:20.942879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.943473 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.943473 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:20.943579 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:20.944067 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:20.944074 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:20.945650 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:20.947670 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:20.947676 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:20.947679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:20.947965 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:20.948246 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:20.948247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:20.948379 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:20.948890 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:20.948897 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:20.949026 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 14:28:20.949133 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 14:28:20.949303 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":37,"thread_start_us":97,"threads_started":1}
I20260811 14:28:20.949422 5630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.939367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:51993 (local address 127.20.132.195:35829)
0811 14:28:20.939537 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:20.939548 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:20.939574 (+ 26us) server_negotiation.cc:407] Connection header received
0811 14:28:20.940069 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:20.940071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:20.940112 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:20.940308 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:20.941110 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.941978 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.942962 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.943371 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.943487 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:20.945771 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:20.945775 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:20.945775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:20.945785 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:20.947583 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948045 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:20.948048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:20.948048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:20.948126 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948469 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:20.948470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:20.948470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:20.948808 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:20.948897 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:20.949186 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 14:28:20.949317 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":52,"threads_started":1}
I20260811 14:28:20.949546 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.939473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39621 (local address 127.20.132.193:37579)
0811 14:28:20.939571 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:20.939580 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:20.939623 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:20.940504 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:20.940505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:20.940810 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:20.940989 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:20.940995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.942078 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.942079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:20.942879 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:20.942881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.943466 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.943467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:20.943579 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:20.944281 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:20.944286 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:20.946126 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:20.948303 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:20.948304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:20.948499 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:20.948780 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:20.948781 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:20.948847 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:20.949220 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:20.949221 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:20.949266 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 14:28:20.949350 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:28:20.949451 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":48,"thread_start_us":51,"threads_started":1}
I20260811 14:28:20.950001 5632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:20.939615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:37579 (local address 127.20.132.194:39621)
0811 14:28:20.939733 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:20.939743 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:20.939762 (+ 19us) server_negotiation.cc:407] Connection header received
0811 14:28:20.940322 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:20.940325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:20.940370 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:20.940509 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:20.941119 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.941976 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.942987 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:20.943370 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:20.943488 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:20.946234 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:20.946238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:20.946238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:20.946249 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:20.948216 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948573 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:20.948576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:20.948576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:20.948710 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:20.948912 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:20.948913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:20.948914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:20.949134 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:20.949224 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:20.949427 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 14:28:20.949865 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":69,"threads_started":1}
W20260811 14:28:20.950556 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
W20260811 14:28:20.950656 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:20.950700 5193 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538f733c6024693ac3223ac69e2e3a4; no voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959
I20260811 14:28:20.950809 5628 raft_consensus.cc:2726] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:28:21.220664 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:21.220526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:44641)
0811 14:28:21.220588 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:21.220623 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 14:28:21.259933 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:21.259673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:49197)
0811 14:28:21.259839 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:21.259888 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
I20260811 14:28:21.383695 5634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:21.383433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:35705)
0811 14:28:21.383590 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:21.383644 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
I20260811 14:28:22.221493 5635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:22.221271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:49355)
0811 14:28:22.221406 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:22.221446 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260811 14:28:22.260680 5636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:22.260470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:45941)
0811 14:28:22.260600 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:22.260638 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260811 14:28:22.384435 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:22.384231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:55579)
0811 14:28:22.384356 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:22.384393 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260811 14:28:22.969483 5640 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:22.969576 5640 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:22.969754 5640 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
W20260811 14:28:22.970157 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
W20260811 14:28:22.970235 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:22.970255 5193 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538f733c6024693ac3223ac69e2e3a4; no voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959
I20260811 14:28:22.970328 5640 raft_consensus.cc:2726] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:28:23.222203 5641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:23.221942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:58709)
0811 14:28:23.222081 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:23.222128 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260811 14:28:23.261356 5642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:23.261116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:58853)
0811 14:28:23.261262 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:23.261297 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260811 14:28:23.385118 5643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:23.384888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:34653)
0811 14:28:23.385026 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:23.385059 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260811 14:28:24.222957 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:24.222729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:58971)
0811 14:28:24.222869 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:24.222910 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":62,"threads_started":1}
I20260811 14:28:24.262176 5645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:24.261873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:49681)
0811 14:28:24.262080 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:24.262123 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":125,"threads_started":1}
I20260811 14:28:24.385792 5646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:24.385565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:42919)
0811 14:28:24.385696 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:24.385746 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260811 14:28:25.223592 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:25.223379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:40689)
0811 14:28:25.223512 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:25.223546 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 14:28:25.262859 5648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:25.262589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:58391)
0811 14:28:25.262761 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:25.262815 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260811 14:28:25.386456 5649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:25.386242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:49799)
0811 14:28:25.386383 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:25.386417 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260811 14:28:25.639093 5650 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:25.639190 5650 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:25.639392 5650 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
W20260811 14:28:25.639840 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
W20260811 14:28:25.639933 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:25.639951 5193 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538f733c6024693ac3223ac69e2e3a4; no voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959
I20260811 14:28:25.640017 5650 raft_consensus.cc:2726] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:28:26.224326 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:26.224064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:36507)
0811 14:28:26.224243 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:26.224280 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260811 14:28:26.263535 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:26.263268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:51497)
0811 14:28:26.263413 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:26.263447 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260811 14:28:26.387176 5653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:26.386952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:57687)
0811 14:28:26.387086 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:26.387121 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260811 14:28:27.225018 5654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:27.224771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:41213)
0811 14:28:27.224935 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:27.224972 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260811 14:28:27.264250 5655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:27.263981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:39973)
0811 14:28:27.264116 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:27.264203 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260811 14:28:27.387784 5656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:27.387588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:54737)
0811 14:28:27.387708 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:27.387742 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260811 14:28:27.535930 5657 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:27.536037 5657 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:27.536262 5657 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
W20260811 14:28:27.536650 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
W20260811 14:28:27.536738 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:27.536759 5193 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538f733c6024693ac3223ac69e2e3a4; no voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959
I20260811 14:28:27.536825 5657 raft_consensus.cc:2726] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:28:28.225870 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:28.225615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:35749)
0811 14:28:28.225774 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:28.225820 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":67,"threads_started":1}
I20260811 14:28:28.264868 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:28.264675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:40515)
0811 14:28:28.264792 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:28.264823 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260811 14:28:28.388505 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:28.388277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:54025)
0811 14:28:28.388427 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:28.388467 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260811 14:28:29.226568 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:29.226353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:55683)
0811 14:28:29.226491 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:29.226521 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260811 14:28:29.265550 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:29.265354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:36157)
0811 14:28:29.265472 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:29.265510 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
I20260811 14:28:29.389119 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:29.388916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:59047)
0811 14:28:29.389039 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:29.389077 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260811 14:28:30.227303 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:30.227076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:54705)
0811 14:28:30.227214 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:30.227252 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260811 14:28:30.266305 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:30.266063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:37019)
0811 14:28:30.266225 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:30.266260 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260811 14:28:30.389778 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:30.389569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:53349)
0811 14:28:30.389695 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:30.389731 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260811 14:28:31.228164 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:31.227902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:46863)
0811 14:28:31.228044 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:31.228081 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260811 14:28:31.266984 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:31.266765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:50471)
0811 14:28:31.266897 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:31.266934 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260811 14:28:31.390460 5669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:31.390223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:60497)
0811 14:28:31.390352 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:31.390389 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":58,"threads_started":1}
I20260811 14:28:31.780453 5670 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:31.780557 5670 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:31.780748 5670 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
W20260811 14:28:31.781181 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
W20260811 14:28:31.781248 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:31.781265 5193 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538f733c6024693ac3223ac69e2e3a4; no voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959
I20260811 14:28:31.781337 5670 raft_consensus.cc:2726] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:28:32.228897 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:32.228653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:55373)
0811 14:28:32.228795 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:32.228850 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":66,"threads_started":1}
I20260811 14:28:32.267678 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:32.267468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:57537)
0811 14:28:32.267596 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:32.267633 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
I20260811 14:28:32.391193 5673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:32.390979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:48301)
0811 14:28:32.391119 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:32.391152 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260811 14:28:33.229745 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:33.229488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:60001)
0811 14:28:33.229651 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:33.229696 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260811 14:28:33.268524 5675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:33.268316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:58971)
0811 14:28:33.268440 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:33.268478 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260811 14:28:33.391746 5676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:33.391562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:38593)
0811 14:28:33.391674 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:33.391706 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260811 14:28:33.660352 5677 raft_consensus.cc:482] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:33.660452 5677 raft_consensus.cc:504] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f4963bd9704e87afa8330e46231959" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 35829 } } peers { permanent_uuid: "84d66e5ba5d348998d2d4d07cbb84e89" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39621 } } peers { permanent_uuid: "c538f733c6024693ac3223ac69e2e3a4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 45253 } }
I20260811 14:28:33.660653 5677 leader_election.cc:288] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829), 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621)
W20260811 14:28:33.661170 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f4963bd9704e87afa8330e46231959 (127.20.132.195:35829): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
W20260811 14:28:33.661237 5193 leader_election.cc:341] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84d66e5ba5d348998d2d4d07cbb84e89 (127.20.132.194:39621): Not found: Tablet not found: 530d73d29bb5469594f51d66cef9205d
I20260811 14:28:33.661293 5193 leader_election.cc:302] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538f733c6024693ac3223ac69e2e3a4; no voters: 84d66e5ba5d348998d2d4d07cbb84e89, 95f4963bd9704e87afa8330e46231959
I20260811 14:28:33.661386 5677 raft_consensus.cc:2726] T 530d73d29bb5469594f51d66cef9205d P c538f733c6024693ac3223ac69e2e3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:28:34.230545 5678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:34.230294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.193:41283)
0811 14:28:34.230458 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:34.230495 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":66,"threads_started":1}
I20260811 14:28:34.269375 5679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:34.269147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.194:49657)
0811 14:28:34.269291 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:34.269326 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260811 14:28:34.392534 5680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:34.392288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37175 (local address 127.20.132.195:40679)
0811 14:28:34.392453 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:34.392489 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":81,"threads_started":1}
I20260811 14:28:34.394022 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 5144
I20260811 14:28:34.401337 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 5325
I20260811 14:28:34.407596 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 5476
2026-08-11T14:28:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18494 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:28:34 dist-test-slave-cbbz krb5kdc[5683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:28:34 dist-test-slave-cbbz krb5kdc[5683](info): set up 2 sockets
Aug 11 14:28:34 dist-test-slave-cbbz krb5kdc[5683](info): commencing operation
krb5kdc: starting...
W20260811 14:28:35.515681 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:28:35 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:28:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:28:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:28:35.635504 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34037
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:34037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:35.719257 5698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:35.719523 5698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:35.719564 5698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:35.720822 5698 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 14:28:35.720885 5698 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 14:28:35.720907 5698 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 14:28:35.720927 5698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:35.720958 5698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:35.720983 5698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:35.721011 5698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:35.721040 5698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:35.722555 5698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:34037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:35.722862 5698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:35.723107 5698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:35.727888 5704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:35.727931 5706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:35.727891 5703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:35.728192 5698 server_base.cc:1034] running on GCE node
I20260811 14:28:35.728453 5698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:35.728757 5698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:35.729923 5698 hybrid_clock.cc:648] HybridClock initialized: now 1786458515729919 us; error 39 us; skew 500 ppm
Aug 11 14:28:35 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458515, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:35.732365 5698 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:35.732805 5698 webserver.cc:460] Webserver started at http://127.20.132.254:42597/ using document root <none> and password file <none>
I20260811 14:28:35.733049 5698 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:35.733117 5698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:35.733278 5698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:35.734318 5698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "73dab259b13b4747a9e1e38932a0ed61"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "8104c302f99ab235080c1a175e95cbee"
server_key_iv: "2d33398655a15b72243bb26a9a665c1f"
server_key_version: "encryptionkey@0"
I20260811 14:28:35.734689 5698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "73dab259b13b4747a9e1e38932a0ed61"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "8104c302f99ab235080c1a175e95cbee"
server_key_iv: "2d33398655a15b72243bb26a9a665c1f"
server_key_version: "encryptionkey@0"
I20260811 14:28:35.736003 5698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:28:35.736830 5716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:35.737012 5698 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:35.737104 5698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "73dab259b13b4747a9e1e38932a0ed61"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "8104c302f99ab235080c1a175e95cbee"
server_key_iv: "2d33398655a15b72243bb26a9a665c1f"
server_key_version: "encryptionkey@0"
I20260811 14:28:35.737196 5698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:35.761413 5698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:35.763433 5698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:35.763607 5698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:35.767654 5698 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:34037
I20260811 14:28:35.767709 5776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:34037 every 8 connection(s)
I20260811 14:28:35.768091 5698 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:35.769012 5777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:35.770970 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5698
I20260811 14:28:35.771076 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:28:35.771281 21011 external_mini_cluster.cc:1428] Setting key ab2ee928d3b0981f2226303d74bfe1c4
I20260811 14:28:35.771639 5777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap starting.
I20260811 14:28:35.772425 5777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:35.772745 5777 log.cc:824] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:35.773535 5777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: No bootstrap required, opened a new log
I20260811 14:28:35.776062 5777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:35.776269 5777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:35.776337 5777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73dab259b13b4747a9e1e38932a0ed61, State: Initialized, Role: FOLLOWER
I20260811 14:28:35.776494 5777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:35.776597 5777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:35.776644 5777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:35.776717 5777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:35.777338 5777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:35.777467 5777 leader_election.cc:302] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73dab259b13b4747a9e1e38932a0ed61; no voters:
I20260811 14:28:35.777662 5777 leader_election.cc:288] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:28:35.777694 5783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:35.777810 5783 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 LEADER]: Becoming Leader. State: Replica: 73dab259b13b4747a9e1e38932a0ed61, State: Running, Role: LEADER
I20260811 14:28:35.777956 5783 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:35.777987 5777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:35.778371 5784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73dab259b13b4747a9e1e38932a0ed61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } } }
Aug 11 14:28:35 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:35.778546 5784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:35.778982 5791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:35.779515 5791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:35.779608 5785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73dab259b13b4747a9e1e38932a0ed61. Latest consensus state: current_term: 1 leader_uuid: "73dab259b13b4747a9e1e38932a0ed61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } } }
I20260811 14:28:35.779784 5785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:35.781325 5791 catalog_manager.cc:1347] Generated new cluster ID: 396d0e505f5b40659537d3bf72441905
I20260811 14:28:35.781388 5791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:35.783702 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:35.771840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45630 (local address 127.20.132.254:34037)
0811 14:28:35.772019 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:35.772028 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:35.772064 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:28:35.772569 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:35.772578 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:35.772639 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:35.772762 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:35.773606 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:35.774656 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:35.775821 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:35.776330 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:35.776437 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:35.779196 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:35.779200 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:35.779201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:35.779214 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:35.782022 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:35.782426 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:35.782429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:35.782429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:35.782538 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:35.782749 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:35.782750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:35.782750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:35.783062 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:35.783209 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:35.783319 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 14:28:35.783468 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260811 14:28:35.805349 5791 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:28:35.806102 5791 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:35.810401 5791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Generated new TSK 0
I20260811 14:28:35.810590 5791 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:28:35.839116 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34037
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:35.920759 5805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:35.920960 5805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:35.920984 5805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:35.922145 5805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:35.922188 5805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:35.922214 5805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:35.923671 5805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:35.923923 5805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:35.924177 5805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:35.929142 5810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:35.929152 5814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:35.929159 5812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:35.929493 5805 server_base.cc:1034] running on GCE node
I20260811 14:28:35.929718 5805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:35.929963 5805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:35.931134 5805 hybrid_clock.cc:648] HybridClock initialized: now 1786458515931127 us; error 41 us; skew 500 ppm
Aug 11 14:28:35 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458515, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:35.933779 5805 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:35.934262 5805 webserver.cc:460] Webserver started at http://127.20.132.193:35529/ using document root <none> and password file <none>
I20260811 14:28:35.934502 5805 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:35.934579 5805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:35.934738 5805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:35.935796 5805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "cee6afaec53442fb853e36e993b3c33b"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "f04b4c4e730a9c41118f5956de5bc15f"
server_key_iv: "c6416715f45b6b6f07144147f3900b00"
server_key_version: "encryptionkey@0"
I20260811 14:28:35.936225 5805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "cee6afaec53442fb853e36e993b3c33b"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "f04b4c4e730a9c41118f5956de5bc15f"
server_key_iv: "c6416715f45b6b6f07144147f3900b00"
server_key_version: "encryptionkey@0"
I20260811 14:28:35.937584 5805 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:35.938354 5821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:35.938560 5805 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:35.938659 5805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "cee6afaec53442fb853e36e993b3c33b"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "f04b4c4e730a9c41118f5956de5bc15f"
server_key_iv: "c6416715f45b6b6f07144147f3900b00"
server_key_version: "encryptionkey@0"
I20260811 14:28:35.938756 5805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:35.967469 5805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:35.969484 5805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:35.969660 5805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:35.969916 5805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:35.970243 5805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:35.970299 5805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:35.970341 5805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:35.970371 5805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:35.976496 5805 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:38049
I20260811 14:28:35.976553 5946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:38049 every 8 connection(s)
I20260811 14:28:35.976864 5805 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:28:35 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458515, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:35.984877 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5805
I20260811 14:28:35.985000 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:28:35.985235 21011 external_mini_cluster.cc:1428] Setting key da6166645920b66b3ba5737cf471eb75
I20260811 14:28:35.986735 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:35.977643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:45431 (local address 127.20.132.254:34037)
0811 14:28:35.977685 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:35.977687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:35.977894 (+ 207us) server_negotiation.cc:407] Connection header received
0811 14:28:35.978515 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:35.978516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:35.978529 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:35.978633 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:35.979710 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:35.980310 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:35.981311 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:35.981548 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:35.981627 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:35.983707 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:35.983708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:35.983709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:35.983715 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:35.985176 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:35.985684 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:35.985685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:35.985686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:35.985760 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:35.986079 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:35.986080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:35.986080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:35.986209 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:35.986284 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:35.986555 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 14:28:35.986646 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:28:35.986936 5950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:35.977592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:45431)
0811 14:28:35.977761 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:35.977805 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:35.978381 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:35.978721 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:35.978725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:35.979347 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:35.979606 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:35.979611 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:35.980404 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:35.980405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:35.981210 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:35.981212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:35.981636 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:35.981637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:35.981785 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:35.982221 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:35.982228 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:35.983614 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:35.985252 (+ 1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:35.985259 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:35.985260 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:35.985590 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:35.985852 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:35.985853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:35.985853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:35.986008 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:35.986287 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:35.986294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:35.986417 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 14:28:35.986517 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 14:28:35.986689 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260811 14:28:35.987970 5947 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34037
I20260811 14:28:35.988070 5947 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:35.988289 5947 heartbeater.cc:511] Master 127.20.132.254:34037 requested a full tablet report, sending...
I20260811 14:28:35.988858 5737 ts_manager.cc:194] Registered new tserver with Master: cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
I20260811 14:28:35.989780 5737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:45431
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:28:36.010949 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34037
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:36.095412 5953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:36.095634 5953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:36.095674 5953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:36.096928 5953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:36.096997 5953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:36.097043 5953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:36.098464 5953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:36.098712 5953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:36.098944 5953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:36.103837 5958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:36.103847 5959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:36.103847 5961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:36.104079 5953 server_base.cc:1034] running on GCE node
I20260811 14:28:36.104310 5953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:36.104610 5953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:36.105779 5953 hybrid_clock.cc:648] HybridClock initialized: now 1786458516105753 us; error 37 us; skew 500 ppm
Aug 11 14:28:36 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458516, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:36.108345 5953 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:36.108762 5953 webserver.cc:460] Webserver started at http://127.20.132.194:46757/ using document root <none> and password file <none>
I20260811 14:28:36.108980 5953 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:36.109045 5953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:36.109191 5953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:36.110200 5953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "1dc262a4ca674ad680490d106a1d3aa8"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "b328acd37ec7c0c6ac452dbeef3917dc"
server_key_iv: "ff0270b3a54edef47cdeaa04e1582fb7"
server_key_version: "encryptionkey@0"
I20260811 14:28:36.110559 5953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "1dc262a4ca674ad680490d106a1d3aa8"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "b328acd37ec7c0c6ac452dbeef3917dc"
server_key_iv: "ff0270b3a54edef47cdeaa04e1582fb7"
server_key_version: "encryptionkey@0"
I20260811 14:28:36.111878 5953 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:36.112672 5969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.112833 5953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.112936 5953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "1dc262a4ca674ad680490d106a1d3aa8"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "b328acd37ec7c0c6ac452dbeef3917dc"
server_key_iv: "ff0270b3a54edef47cdeaa04e1582fb7"
server_key_version: "encryptionkey@0"
I20260811 14:28:36.113020 5953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:36.160599 5953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:36.163250 5953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:36.163523 5953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:36.163831 5953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:36.164182 5953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:36.164242 5953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.164276 5953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:36.164320 5953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.170236 5953 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:38275
I20260811 14:28:36.170289 6094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:38275 every 8 connection(s)
I20260811 14:28:36.170612 5953 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:36.176357 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 5953
Aug 11 14:28:36 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458516, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:36.176487 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:28:36.176702 21011 external_mini_cluster.cc:1428] Setting key 990286f954edeaec866f0794c5133df6
I20260811 14:28:36.180508 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.171292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:41371 (local address 127.20.132.254:34037)
0811 14:28:36.171379 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.171382 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.171567 (+ 185us) server_negotiation.cc:407] Connection header received
0811 14:28:36.172038 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.172039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.172049 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.172102 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:36.173095 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.173591 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.174561 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.174739 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.174791 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.177030 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:36.177031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:36.177032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:36.177039 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:36.178864 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:36.179367 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:36.179368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:36.179369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:36.179440 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:36.179710 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:36.179711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:36.179711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:36.179839 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:36.179943 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.180258 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.180371 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:28:36.180531 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.171249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:41371)
0811 14:28:36.171445 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.171481 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.171952 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.172240 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.172244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.172807 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:36.173013 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.173018 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.173673 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.173674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.174484 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.174486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.174807 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.174808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.174905 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.175370 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:36.175378 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:36.176913 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:36.178949 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:36.178957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:36.178959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:36.179269 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:36.179511 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:36.179511 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:36.179512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:36.179630 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:36.179937 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:36.179945 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:36.180085 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.180221 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.180366 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":112,"threads_started":1}
I20260811 14:28:36.181223 6095 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34037
I20260811 14:28:36.181326 6095 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:36.181524 6095 heartbeater.cc:511] Master 127.20.132.254:34037 requested a full tablet report, sending...
I20260811 14:28:36.181896 5737 ts_manager.cc:194] Registered new tserver with Master: 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275)
I20260811 14:28:36.182286 5737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:41371
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:28:36.203873 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34037
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:36.286954 6101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:36.287184 6101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:36.287223 6101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:36.288426 6101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:36.288491 6101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:36.288543 6101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:36.290104 6101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:36.290372 6101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:36.290601 6101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:36.295629 6107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:36.295642 6110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:36.295640 6108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:36.295692 6101 server_base.cc:1034] running on GCE node
I20260811 14:28:36.296113 6101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:36.296418 6101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:36.297583 6101 hybrid_clock.cc:648] HybridClock initialized: now 1786458516297580 us; error 37 us; skew 500 ppm
Aug 11 14:28:36 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458516, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:36.300016 6101 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:36.300556 6101 webserver.cc:460] Webserver started at http://127.20.132.195:36377/ using document root <none> and password file <none>
I20260811 14:28:36.300791 6101 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:36.300861 6101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:36.301015 6101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:28:36.302078 6101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "ac8e9065d02646f1945de055d1803d3c"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "a58bb41991e7baed05211dedc4023657"
server_key_iv: "a62e90761930cc55f03fce2fab5006d2"
server_key_version: "encryptionkey@0"
I20260811 14:28:36.302444 6101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "ac8e9065d02646f1945de055d1803d3c"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "a58bb41991e7baed05211dedc4023657"
server_key_iv: "a62e90761930cc55f03fce2fab5006d2"
server_key_version: "encryptionkey@0"
I20260811 14:28:36.303767 6101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:28:36.304581 6117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.304775 6101 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.304881 6101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "ac8e9065d02646f1945de055d1803d3c"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "a58bb41991e7baed05211dedc4023657"
server_key_iv: "a62e90761930cc55f03fce2fab5006d2"
server_key_version: "encryptionkey@0"
I20260811 14:28:36.304952 6101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:36.320971 6101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:36.322865 6101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:36.323029 6101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:36.323280 6101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:36.323591 6101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:36.323647 6101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.323719 6101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:36.323751 6101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:36.329842 6101 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:42023
I20260811 14:28:36.329895 6244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:42023 every 8 connection(s)
I20260811 14:28:36.330210 6101 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:28:36 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458516, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:36.338886 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.330938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:54129 (local address 127.20.132.254:34037)
0811 14:28:36.331019 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.331021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.331193 (+ 172us) server_negotiation.cc:407] Connection header received
0811 14:28:36.331662 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.331664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.331679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.331733 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:36.332725 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.333218 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.334274 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.334472 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.334525 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.336592 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:36.336593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:36.336593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:36.336599 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:36.337781 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:36.338134 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:36.338135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:36.338135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:36.338183 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:36.338389 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:36.338389 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:36.338390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:36.338486 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:36.338537 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.338760 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.338821 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:28:36.339051 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.330888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:54129)
0811 14:28:36.331068 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.331105 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.331579 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.331814 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.331817 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.332450 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:36.332638 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.332642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.333297 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.333298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.334193 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.334196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.334545 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.334545 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.334640 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.335113 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:36.335121 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:36.336509 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:36.337849 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:36.337855 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:36.337856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:36.338069 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:36.338240 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:36.338240 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:36.338240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:36.338335 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:36.338540 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:36.338544 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:36.338652 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.338733 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.338856 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":97,"threads_started":1}
I20260811 14:28:36.339468 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6101
I20260811 14:28:36.339584 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:28:36.339583 6245 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34037
I20260811 14:28:36.339701 6245 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:36.339771 21011 external_mini_cluster.cc:1428] Setting key 8fa19e33bbcd90c72f0b37c7ee281c7d
I20260811 14:28:36.339903 6245 heartbeater.cc:511] Master 127.20.132.254:34037 requested a full tablet report, sending...
I20260811 14:28:36.340322 5737 ts_manager.cc:194] Registered new tserver with Master: ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023)
I20260811 14:28:36.340716 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:28:36.340816 5737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:54129
I20260811 14:28:36.347824 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.342066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45646 (local address 127.20.132.254:34037)
0811 14:28:36.342124 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.342126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.342236 (+ 110us) server_negotiation.cc:407] Connection header received
0811 14:28:36.342311 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.342312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.342322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.342377 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:36.342919 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.343381 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.344091 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.344332 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.344408 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.345519 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:36.345521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:36.345521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:36.345528 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:36.346605 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:36.346970 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:36.346971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:36.346972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:36.347029 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:36.347271 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:36.347272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:36.347273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:36.347423 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:36.347532 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.347643 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.347727 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:28:36.349196 5737 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:28:36.350688 5737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:28:36.357056 6259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.352929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:38275 (local address 127.0.0.1:34750)
0811 14:28:36.353240 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.353261 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.353318 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.353639 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.353640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.353642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:36.353690 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.353692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.354656 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.354657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.355981 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.355983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.356708 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.356798 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.356812 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.356883 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.356945 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":3,"thread_start_us":85,"threads_started":1}
I20260811 14:28:36.357081 6260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.353052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34750 (local address 127.20.132.194:38275)
0811 14:28:36.353463 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.353468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.353478 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:28:36.353519 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.353521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.353535 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.353770 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:36.353856 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.354553 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356074 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.356613 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356676 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.356711 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.356927 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.356974 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":83,"threads_started":1}
I20260811 14:28:36.357071 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.353096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.0.0.1:46514)
0811 14:28:36.353346 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.353355 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.353399 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.353820 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.353821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.353823 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:36.353875 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.353877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.355100 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.355101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.355996 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.355999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.356809 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.356884 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.356888 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.356942 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.356981 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":101,"threads_started":1}
I20260811 14:28:36.357508 6264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.353359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46514 (local address 127.20.132.193:38049)
0811 14:28:36.353640 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.353645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.353654 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:36.353694 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.353696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.353711 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.353820 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:36.353949 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.355003 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356199 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.356714 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356799 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.356858 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.357153 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.357202 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":101,"threads_started":1}
I20260811 14:28:36.357983 6258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.352885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:42023 (local address 127.0.0.1:55248)
0811 14:28:36.352990 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.353029 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.353087 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.353454 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.353457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.353460 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:36.353529 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.353531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.354906 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.354907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.355981 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.355983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.357737 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.357738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.357798 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.357802 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.357872 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.357909 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":3,"thread_start_us":63,"threads_started":1}
I20260811 14:28:36.358006 6261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.353088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55248 (local address 127.20.132.195:42023)
0811 14:28:36.353264 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.353268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.353279 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:28:36.353319 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.353321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.353338 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.353612 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:36.353694 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.354800 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.356743 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.357517 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.357596 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.357652 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.357889 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.357931 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260811 14:28:36.358016 6023 tablet_service.cc:1467] Processing CreateTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 (DEFAULT_TABLE table=test-table [id=45ef7a2342764a8597b7fc9fc4aa267f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:36.358187 5877 tablet_service.cc:1467] Processing CreateTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 (DEFAULT_TABLE table=test-table [id=45ef7a2342764a8597b7fc9fc4aa267f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:36.358407 6023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fae3b8fd6334977926bfa68b6650b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:36.358538 5877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fae3b8fd6334977926bfa68b6650b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:36.361014 6265 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Bootstrap starting.
I20260811 14:28:36.361351 6266 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Bootstrap starting.
I20260811 14:28:36.361681 6265 tablet_bootstrap.cc:654] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:36.361596 6171 tablet_service.cc:1467] Processing CreateTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 (DEFAULT_TABLE table=test-table [id=45ef7a2342764a8597b7fc9fc4aa267f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:36.361953 6171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fae3b8fd6334977926bfa68b6650b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:36.362026 6266 tablet_bootstrap.cc:654] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:36.362272 6265 log.cc:824] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:36.362644 6266 log.cc:824] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:36.363025 6265 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: No bootstrap required, opened a new log
I20260811 14:28:36.363103 6265 ts_tablet_manager.cc:1397] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:28:36.363430 6266 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: No bootstrap required, opened a new log
I20260811 14:28:36.363534 6266 ts_tablet_manager.cc:1397] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:28:36.364863 6269 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Bootstrap starting.
I20260811 14:28:36.365278 6265 raft_consensus.cc:348] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.365445 6269 tablet_bootstrap.cc:654] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:36.365468 6265 raft_consensus.cc:374] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:36.365505 6265 raft_consensus.cc:729] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee6afaec53442fb853e36e993b3c33b, State: Initialized, Role: FOLLOWER
I20260811 14:28:36.365706 6265 consensus_queue.cc:260] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.365978 6269 log.cc:824] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:36.365996 6265 ts_tablet_manager.cc:1428] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:28:36.365954 6266 raft_consensus.cc:348] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.366120 6266 raft_consensus.cc:374] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:36.366156 6266 raft_consensus.cc:729] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc262a4ca674ad680490d106a1d3aa8, State: Initialized, Role: FOLLOWER
I20260811 14:28:36.366160 5947 heartbeater.cc:503] Master 127.20.132.254:34037 was elected leader, sending a full tablet report...
I20260811 14:28:36.366295 6266 consensus_queue.cc:260] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.366567 6266 ts_tablet_manager.cc:1428] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:28:36.366689 6095 heartbeater.cc:503] Master 127.20.132.254:34037 was elected leader, sending a full tablet report...
I20260811 14:28:36.366734 6269 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: No bootstrap required, opened a new log
I20260811 14:28:36.366787 6269 ts_tablet_manager.cc:1397] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:28:36.368528 6269 raft_consensus.cc:348] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.368650 6269 raft_consensus.cc:374] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:36.368702 6269 raft_consensus.cc:729] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8e9065d02646f1945de055d1803d3c, State: Initialized, Role: FOLLOWER
I20260811 14:28:36.368815 6269 consensus_queue.cc:260] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.369069 6269 ts_tablet_manager.cc:1428] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 14:28:36.369119 6245 heartbeater.cc:503] Master 127.20.132.254:34037 was elected leader, sending a full tablet report...
W20260811 14:28:36.421217 6097 tablet.cc:2369] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:28:36.475943 6272 raft_consensus.cc:482] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:36.476073 6272 raft_consensus.cc:504] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.476531 6272 leader_election.cc:288] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023), cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
W20260811 14:28:36.477591 5949 tablet.cc:2369] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:28:36.480041 6264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.476949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:52391 (local address 127.20.132.193:38049)
0811 14:28:36.477015 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.477017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.477110 (+ 93us) server_negotiation.cc:407] Connection header received
0811 14:28:36.477175 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.477176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.477192 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.477259 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:36.477359 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.478067 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.479254 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.479688 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.479774 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.479783 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.479932 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.479972 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:28:36.480041 6261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.476821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:55463 (local address 127.20.132.195:42023)
0811 14:28:36.476890 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.476892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.476901 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:36.476937 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.476938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.476952 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.477031 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:36.477194 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.478012 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.479219 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.479672 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.479781 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.479790 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.479929 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.479966 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:28:36.480059 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.476722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:42023 (local address 127.20.132.194:55463)
0811 14:28:36.476782 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.476794 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.476839 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.477038 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.477039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.477041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:36.477118 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.477120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.478120 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.478122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.479118 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.479121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.479758 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.479759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.479842 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.479847 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.479921 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.479967 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":54}
I20260811 14:28:36.480068 6274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.476842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.20.132.194:52391)
0811 14:28:36.477038 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.477048 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:36.477105 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:36.477264 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:36.477265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:36.477266 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:36.477315 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.477315 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.478139 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.478139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.479155 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:36.479159 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.479774 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.479775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:36.479855 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.479858 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:36.479924 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 14:28:36.479969 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":31,"thread_start_us":129,"threads_started":1}
I20260811 14:28:36.480441 6195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fae3b8fd6334977926bfa68b6650b27" candidate_uuid: "1dc262a4ca674ad680490d106a1d3aa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8e9065d02646f1945de055d1803d3c" is_pre_election: true
I20260811 14:28:36.480618 6195 raft_consensus.cc:2454] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc262a4ca674ad680490d106a1d3aa8 in term 0.
I20260811 14:28:36.480890 5973 leader_election.cc:302] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc262a4ca674ad680490d106a1d3aa8, ac8e9065d02646f1945de055d1803d3c; no voters:
I20260811 14:28:36.481016 6272 raft_consensus.cc:2781] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:28:36.481074 6272 raft_consensus.cc:482] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:28:36.481017 5898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fae3b8fd6334977926bfa68b6650b27" candidate_uuid: "1dc262a4ca674ad680490d106a1d3aa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee6afaec53442fb853e36e993b3c33b" is_pre_election: true
I20260811 14:28:36.481101 6272 raft_consensus.cc:3037] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:36.481189 5898 raft_consensus.cc:2454] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc262a4ca674ad680490d106a1d3aa8 in term 0.
I20260811 14:28:36.481957 6272 raft_consensus.cc:504] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.482095 6272 leader_election.cc:288] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [CANDIDATE]: Term 1 election: Requested vote from peers ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023), cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
I20260811 14:28:36.482232 6195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fae3b8fd6334977926bfa68b6650b27" candidate_uuid: "1dc262a4ca674ad680490d106a1d3aa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8e9065d02646f1945de055d1803d3c"
I20260811 14:28:36.482264 5898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fae3b8fd6334977926bfa68b6650b27" candidate_uuid: "1dc262a4ca674ad680490d106a1d3aa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee6afaec53442fb853e36e993b3c33b"
I20260811 14:28:36.482308 6195 raft_consensus.cc:3037] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:36.482344 5898 raft_consensus.cc:3037] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:36.483027 6195 raft_consensus.cc:2454] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc262a4ca674ad680490d106a1d3aa8 in term 1.
I20260811 14:28:36.483036 5898 raft_consensus.cc:2454] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc262a4ca674ad680490d106a1d3aa8 in term 1.
I20260811 14:28:36.483219 5973 leader_election.cc:302] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc262a4ca674ad680490d106a1d3aa8, ac8e9065d02646f1945de055d1803d3c; no voters:
I20260811 14:28:36.483335 6272 raft_consensus.cc:2781] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:36.483539 6272 raft_consensus.cc:686] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 LEADER]: Becoming Leader. State: Replica: 1dc262a4ca674ad680490d106a1d3aa8, State: Running, Role: LEADER
I20260811 14:28:36.483644 6272 consensus_queue.cc:237] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:36.484555 5737 catalog_manager.cc:5495] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194). New cstate: current_term: 1 leader_uuid: "1dc262a4ca674ad680490d106a1d3aa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } health_report { overall_health: HEALTHY } } }
I20260811 14:28:36.504633 6260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.502393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34758 (local address 127.20.132.194:38275)
0811 14:28:36.502445 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:36.502448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:36.502457 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:36.502537 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:36.502540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:36.502565 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:36.502630 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:36.502759 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.503208 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.503918 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:36.504099 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:36.504213 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:36.504355 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:36.504448 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:28:36.504509 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:36.504546 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 14:28:36.504563 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 14:28:36.506392 5898 raft_consensus.cc:1261] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Refusing update from remote peer 1dc262a4ca674ad680490d106a1d3aa8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:36.506450 6195 raft_consensus.cc:1261] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Refusing update from remote peer 1dc262a4ca674ad680490d106a1d3aa8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:36.506752 6272 consensus_queue.cc:1035] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:36.506903 6275 consensus_queue.cc:1035] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:36.509119 6279 mvcc.cc:205] Tried to move back new op lower bound from 7317334083607408640 to 7317334083517751296. Current Snapshot: MvccSnapshot[applied={T|T < 7317334083607408640}]
I20260811 14:28:36.509416 6281 mvcc.cc:205] Tried to move back new op lower bound from 7317334083607408640 to 7317334083517751296. Current Snapshot: MvccSnapshot[applied={T|T < 7317334083607408640}]
I20260811 14:28:36.509902 6280 mvcc.cc:205] Tried to move back new op lower bound from 7317334083607408640 to 7317334083517751296. Current Snapshot: MvccSnapshot[applied={T|T < 7317334083607408640}]
I20260811 14:28:36.511981 5736 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:36.512087 5736 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:36.512871 5736 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Sending DeleteTablet for 3 replicas of tablet 9fae3b8fd6334977926bfa68b6650b27
I20260811 14:28:36.513218 6023 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:36 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:34750
I20260811 14:28:36.513250 6171 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:36 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:55248
I20260811 14:28:36.513242 5877 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:36 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:46514
I20260811 14:28:36.513481 6290 tablet_replica.cc:330] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: stopping tablet replica
I20260811 14:28:36.513590 6290 raft_consensus.cc:2229] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:36.513608 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 5805
I20260811 14:28:36.513702 6290 raft_consensus.cc:2258] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:36.517647 6288 tablet_replica.cc:330] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: stopping tablet replica
I20260811 14:28:36.517822 6288 raft_consensus.cc:2229] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:28:36.517983 6288 raft_consensus.cc:2258] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:36.518151 6289 tablet_replica.cc:330] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: stopping tablet replica
I20260811 14:28:36.518280 6289 raft_consensus.cc:2229] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:36.518388 6289 raft_consensus.cc:2258] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:36.518446 6288 ts_tablet_manager.cc:1905] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:36.519207 6289 ts_tablet_manager.cc:1905] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:36.520406 6288 ts_tablet_manager.cc:1918] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:36.520546 6288 log.cc:1196] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/9fae3b8fd6334977926bfa68b6650b27
I20260811 14:28:36.520912 6288 ts_tablet_manager.cc:1939] T 9fae3b8fd6334977926bfa68b6650b27 P 1dc262a4ca674ad680490d106a1d3aa8: Deleting consensus metadata
I20260811 14:28:36.521270 6289 ts_tablet_manager.cc:1918] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:36.521404 5722 catalog_manager.cc:4841] TS 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275): tablet 9fae3b8fd6334977926bfa68b6650b27 (table test-table [id=45ef7a2342764a8597b7fc9fc4aa267f]) successfully deleted
I20260811 14:28:36.521520 6289 log.cc:1196] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/9fae3b8fd6334977926bfa68b6650b27
I20260811 14:28:36.521878 6289 ts_tablet_manager.cc:1939] T 9fae3b8fd6334977926bfa68b6650b27 P ac8e9065d02646f1945de055d1803d3c: Deleting consensus metadata
I20260811 14:28:36.522320 5721 catalog_manager.cc:4841] TS ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023): tablet 9fae3b8fd6334977926bfa68b6650b27 (table test-table [id=45ef7a2342764a8597b7fc9fc4aa267f]) successfully deleted
W20260811 14:28:36.523464 5721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:38049 (error 108)
I20260811 14:28:36.523810 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 5953
I20260811 14:28:36.524770 6259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:36.523883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.0.0.1:46516)
0811 14:28:36.524676 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:36.524731 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:38049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":769}
W20260811 14:28:36.528944 5721 catalog_manager.cc:4584] TS cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9fae3b8fd6334977926bfa68b6650b27: Network error: Client connection negotiation failed: client connection to 127.20.132.193:38049: connect: Connection refused (error 111)
I20260811 14:28:36.532881 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 6101
I20260811 14:28:36.540637 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 5698
I20260811 14:28:56.547701 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34037
--webserver_interface=127.20.132.254
--webserver_port=42597
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:34037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:28:56.629320 6292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:56.629510 6292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:56.629534 6292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:56.630697 6292 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 14:28:56.630738 6292 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 14:28:56.630753 6292 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 14:28:56.630765 6292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:28:56.630779 6292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:56.630792 6292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:56.630805 6292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:28:56.630820 6292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:28:56.632251 6292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:34037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=42597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:56.632438 6292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:56.632602 6292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:56.642474 6301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:56.642536 6292 server_base.cc:1034] running on GCE node
W20260811 14:28:56.642474 6303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:56.642727 6300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:56.643102 6292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:56.643440 6292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:56.644570 6292 hybrid_clock.cc:648] HybridClock initialized: now 1786458536644555 us; error 33 us; skew 500 ppm
Aug 11 14:28:56 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458536, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:56.648216 6292 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:28:56.648775 6292 webserver.cc:460] Webserver started at http://127.20.132.254:42597/ using document root <none> and password file <none>
I20260811 14:28:56.649077 6292 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:56.649164 6292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:56.650624 6292 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:56.651257 6311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.651458 6292 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.651526 6292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "73dab259b13b4747a9e1e38932a0ed61"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "8104c302f99ab235080c1a175e95cbee"
server_key_iv: "2d33398655a15b72243bb26a9a665c1f"
server_key_version: "encryptionkey@0"
I20260811 14:28:56.651906 6292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:56.665712 6292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:56.667445 6292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:56.667557 6292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:56.671736 6292 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:34037
I20260811 14:28:56.671794 6370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:34037 every 8 connection(s)
I20260811 14:28:56.672255 6292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:28:56.673290 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6292
I20260811 14:28:56.673596 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:38049
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:34037
--webserver_port=35529
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:56.673902 6371 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:28:56.674546 6371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap starting.
I20260811 14:28:56.683115 6371 log.cc:824] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:56.685076 6371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:56.685390 6371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap complete.
I20260811 14:28:56.687657 6371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:56.687904 6371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73dab259b13b4747a9e1e38932a0ed61, State: Initialized, Role: FOLLOWER
I20260811 14:28:56.688090 6371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:56.688200 6371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:28:56.688264 6371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:28:56.688318 6371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:28:56.689313 6371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:56.689435 6371 leader_election.cc:302] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73dab259b13b4747a9e1e38932a0ed61; no voters:
I20260811 14:28:56.689633 6371 leader_election.cc:288] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 14:28:56.689675 6376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:28:56.689797 6376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 LEADER]: Becoming Leader. State: Replica: 73dab259b13b4747a9e1e38932a0ed61, State: Running, Role: LEADER
I20260811 14:28:56.689882 6376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:28:56.689911 6371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:28:56.690191 6377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "73dab259b13b4747a9e1e38932a0ed61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } } }
I20260811 14:28:56.690297 6377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:56.690497 6380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:28:56.691398 6380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:28:56.691449 6378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73dab259b13b4747a9e1e38932a0ed61. Latest consensus state: current_term: 2 leader_uuid: "73dab259b13b4747a9e1e38932a0ed61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } } }
I20260811 14:28:56.691527 6378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:28:56.691684 6380 catalog_manager.cc:1259] Loaded cluster ID: 396d0e505f5b40659537d3bf72441905
I20260811 14:28:56.691983 6380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:28:56.692951 6380 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:28:56.693148 6380 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Loaded TSK: 0
I20260811 14:28:56.700451 6380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Generated new TSK 1
I20260811 14:28:56.700559 6380 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:28:56.766644 6374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:56.766842 6374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:56.766866 6374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:56.768009 6374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:56.768050 6374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:56.768076 6374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:28:56.769527 6374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:38049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=35529
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:56.769752 6374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:56.769995 6374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:56.775955 6404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:56.775974 6402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:56.776089 6374 server_base.cc:1034] running on GCE node
W20260811 14:28:56.776271 6401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:56.776490 6374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:56.776770 6374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:56.777930 6374 hybrid_clock.cc:648] HybridClock initialized: now 1786458536777919 us; error 28 us; skew 500 ppm
Aug 11 14:28:56 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458536, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:56.780742 6374 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:28:56.781303 6374 webserver.cc:460] Webserver started at http://127.20.132.193:35529/ using document root <none> and password file <none>
I20260811 14:28:56.781590 6374 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:56.781680 6374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:56.783521 6374 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:28:56.784406 6411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.784634 6374 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:56.784737 6374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "cee6afaec53442fb853e36e993b3c33b"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "f04b4c4e730a9c41118f5956de5bc15f"
server_key_iv: "c6416715f45b6b6f07144147f3900b00"
server_key_version: "encryptionkey@0"
I20260811 14:28:56.785166 6374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:56.810998 6374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:56.813689 6374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:56.813839 6374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:56.814088 6374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:56.814595 6419 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 14:28:56.816196 6374 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 14:28:56.816257 6374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 14:28:56.816295 6374 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 14:28:56.817171 6374 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 14:28:56.817224 6374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 14:28:56.817301 6419 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Bootstrap starting.
I20260811 14:28:56.824506 6374 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:38049
I20260811 14:28:56.824760 6546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:38049 every 8 connection(s)
I20260811 14:28:56.824970 6374 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:28:56.828402 6419 log.cc:824] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:56.829715 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6374
I20260811 14:28:56.830042 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:38275
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:34037
--webserver_port=46757
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:28:56.831319 6419 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:28:56.831606 6419 tablet_bootstrap.cc:492] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Bootstrap complete.
I20260811 14:28:56.832983 6419 ts_tablet_manager.cc:1397] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260811 14:28:56.834149 6419 raft_consensus.cc:348] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:56.834406 6419 raft_consensus.cc:729] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee6afaec53442fb853e36e993b3c33b, State: Initialized, Role: FOLLOWER
I20260811 14:28:56.836335 6419 consensus_queue.cc:260] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } } peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } }
I20260811 14:28:56.836735 6419 ts_tablet_manager.cc:1428] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
Aug 11 14:28:56 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458536, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:56.845752 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:56.825728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:55061)
0811 14:28:56.828201 (+ 2473us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:56.828250 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:56.828873 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:56.829373 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:56.829377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:56.829735 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:56.829992 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:56.829998 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.831756 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.831756 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:56.833043 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:56.833046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.834005 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.834006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:56.834159 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:56.834780 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:56.834791 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:56.838080 (+ 3289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:56.843929 (+ 5849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:56.843936 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:56.843938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:56.844254 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:56.844552 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:56.844553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:56.844554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:56.844703 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:56.845162 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:56.845170 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:56.845326 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 14:28:56.845441 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 14:28:56.845609 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2414,"thread_start_us":110,"threads_started":1}
I20260811 14:28:56.845867 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:56.825836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:55061 (local address 127.20.132.254:34037)
0811 14:28:56.826034 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:56.826043 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:56.828402 (+ 2359us) server_negotiation.cc:407] Connection header received
0811 14:28:56.829103 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:56.829111 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:56.829174 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:56.829329 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:56.830136 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.831566 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.833153 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.833778 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.833856 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:56.838200 (+ 4344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:56.838205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:56.838205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:56.838220 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:56.843828 (+ 5608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:56.844353 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:56.844356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:56.844357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:56.844475 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:56.844789 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:56.844790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:56.844790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:56.845079 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:56.845161 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:56.845527 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 14:28:56.845671 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":88,"threads_started":1}
I20260811 14:28:56.846552 6547 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34037
I20260811 14:28:56.846683 6547 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:56.846881 6547 heartbeater.cc:511] Master 127.20.132.254:34037 requested a full tablet report, sending...
I20260811 14:28:56.847625 6330 ts_manager.cc:194] Registered new tserver with Master: cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
I20260811 14:28:56.848843 6330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:55061
I20260811 14:28:56.849730 6547 heartbeater.cc:503] Master 127.20.132.254:34037 was elected leader, sending a full tablet report...
Aug 11 14:28:56 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458536, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:28:56.856899 6556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:56.848350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.20.132.193:38049)
0811 14:28:56.848503 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:56.848507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:56.848644 (+ 137us) server_negotiation.cc:407] Connection header received
0811 14:28:56.848768 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:56.848771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:56.848790 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:56.848860 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:56.849409 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.850551 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.851271 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.851719 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.851799 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:56.853785 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:56.853792 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:56.853793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:56.853800 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:56.855554 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:56.855937 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:56.855939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:56.855939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:56.856010 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:56.856243 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:56.856244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:56.856245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:56.856410 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:56.856512 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:56.856716 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 14:28:56.856809 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
I20260811 14:28:56.856899 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:56.848292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.0.0.1:58070)
0811 14:28:56.848527 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:56.848564 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:56.848662 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:56.848877 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:56.848883 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:56.849241 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:56.849325 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:56.849327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.850636 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.850636 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:56.851193 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:56.851195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.851805 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.851805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:56.851861 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:56.852401 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:56.852408 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:56.853701 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:56.855632 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:56.855650 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:56.855652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:56.855857 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:56.856087 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:56.856087 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:56.856088 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:56.856187 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:56.856503 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:56.856510 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:56.856579 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 14:28:56.856676 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 14:28:56.856800 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":99,"threads_started":1}
I20260811 14:28:56.857522 6470 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fae3b8fd6334977926bfa68b6650b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:36 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:58070
I20260811 14:28:56.858117 6557 tablet_replica.cc:330] stopping tablet replica
I20260811 14:28:56.858238 6557 raft_consensus.cc:2229] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:56.858318 6557 raft_consensus.cc:2258] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:56.858685 6557 ts_tablet_manager.cc:1905] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:56.865809 6557 ts_tablet_manager.cc:1918] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:56.865923 6557 log.cc:1196] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal/wals/9fae3b8fd6334977926bfa68b6650b27
I20260811 14:28:56.866200 6557 ts_tablet_manager.cc:1939] T 9fae3b8fd6334977926bfa68b6650b27 P cee6afaec53442fb853e36e993b3c33b: Deleting consensus metadata
I20260811 14:28:56.866806 6314 catalog_manager.cc:4841] TS cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049): tablet 9fae3b8fd6334977926bfa68b6650b27 (table test-table [id=45ef7a2342764a8597b7fc9fc4aa267f]) successfully deleted
W20260811 14:28:56.921205 6553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:56.921411 6553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:56.921435 6553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:56.922608 6553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:56.922650 6553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:56.922703 6553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:28:56.924109 6553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:38275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=46757
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:56.924372 6553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:56.924607 6553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:56.929451 6562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:56.929512 6564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:56.929507 6566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:56.929708 6553 server_base.cc:1034] running on GCE node
I20260811 14:28:56.929922 6553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:56.930184 6553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:56.931352 6553 hybrid_clock.cc:648] HybridClock initialized: now 1786458536931337 us; error 27 us; skew 500 ppm
Aug 11 14:28:56 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458536, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:56.933854 6553 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:28:56.934284 6553 webserver.cc:460] Webserver started at http://127.20.132.194:46757/ using document root <none> and password file <none>
I20260811 14:28:56.934505 6553 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:56.934589 6553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:56.935889 6553 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:28:56.936514 6573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.936678 6553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.936775 6553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "1dc262a4ca674ad680490d106a1d3aa8"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "b328acd37ec7c0c6ac452dbeef3917dc"
server_key_iv: "ff0270b3a54edef47cdeaa04e1582fb7"
server_key_version: "encryptionkey@0"
I20260811 14:28:56.937103 6553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:56.973392 6553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:56.975260 6553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:56.975432 6553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:56.975687 6553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:56.976007 6553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:56.976061 6553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.976096 6553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:56.976137 6553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:56.982290 6553 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:38275
I20260811 14:28:56.982342 6706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:38275 every 8 connection(s)
I20260811 14:28:56.982681 6553 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:28:56.988245 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6553
I20260811 14:28:56.988551 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:42023
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:34037
--webserver_port=36377
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:28:56 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458536, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:56.992612 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:56.983422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:42611 (local address 127.20.132.254:34037)
0811 14:28:56.983490 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:56.983492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:56.983715 (+ 223us) server_negotiation.cc:407] Connection header received
0811 14:28:56.984290 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:56.984292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:56.984304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:56.984358 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:56.985326 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.985835 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.986845 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.987056 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.987141 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:56.989341 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:56.989342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:56.989343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:56.989351 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:56.991163 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:56.991601 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:56.991603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:56.991603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:56.991669 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:56.991953 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:56.991954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:56.991954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:56.992058 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:56.992109 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:56.992471 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 14:28:56.992548 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:28:56.992905 6709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:56.983421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:42611)
0811 14:28:56.983585 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:56.983629 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:56.984165 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:56.984427 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:56.984431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:56.985019 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:56.985208 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:56.985212 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.985943 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.985944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:56.986749 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:56.986751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:56.987154 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:56.987155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:56.987292 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:56.987754 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:56.987763 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:56.989245 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:56.991243 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:56.991250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:56.991251 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:56.991472 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:56.991739 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:56.991740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:56.991741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:56.991885 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:56.992124 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:56.992130 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:56.992324 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 14:28:56.992438 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 14:28:56.992617 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260811 14:28:56.993456 6707 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34037
I20260811 14:28:56.993575 6707 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:56.993760 6707 heartbeater.cc:511] Master 127.20.132.254:34037 requested a full tablet report, sending...
I20260811 14:28:56.994146 6330 ts_manager.cc:194] Registered new tserver with Master: 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275)
I20260811 14:28:56.994529 6330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:42611
W20260811 14:28:57.075335 6711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:28:57.075551 6711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:28:57.075584 6711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:28:57.076802 6711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:28:57.076866 6711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:28:57.076911 6711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:28:57.078369 6711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:42023
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=36377
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:28:57.078651 6711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:28:57.078878 6711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:28:57.083734 6717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:57.083825 6711 server_base.cc:1034] running on GCE node
W20260811 14:28:57.083725 6720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:28:57.083727 6718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:28:57.084224 6711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:28:57.084466 6711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:28:57.085631 6711 hybrid_clock.cc:648] HybridClock initialized: now 1786458537085610 us; error 35 us; skew 500 ppm
Aug 11 14:28:57 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458537, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:28:57.088088 6711 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:28:57.088526 6711 webserver.cc:460] Webserver started at http://127.20.132.195:36377/ using document root <none> and password file <none>
I20260811 14:28:57.088766 6711 fs_manager.cc:359] Metadata directory not provided
I20260811 14:28:57.088848 6711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:28:57.090250 6711 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 14:28:57.090906 6728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:57.091092 6711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:57.091192 6711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "ac8e9065d02646f1945de055d1803d3c"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "a58bb41991e7baed05211dedc4023657"
server_key_iv: "a62e90761930cc55f03fce2fab5006d2"
server_key_version: "encryptionkey@0"
I20260811 14:28:57.091496 6711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:28:57.108372 6711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:28:57.110231 6711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:28:57.110342 6711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:28:57.110524 6711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:28:57.110819 6711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:28:57.110854 6711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:57.110898 6711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:28:57.110925 6711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:28:57.117007 6711 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:42023
I20260811 14:28:57.117053 6855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:42023 every 8 connection(s)
I20260811 14:28:57.117379 6711 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:28:57 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458537, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:28:57.125698 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.118089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:35107 (local address 127.20.132.254:34037)
0811 14:28:57.118152 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.118153 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.118349 (+ 196us) server_negotiation.cc:407] Connection header received
0811 14:28:57.118809 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.118810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.118820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.118880 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:57.119745 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.120228 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.121153 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.121331 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.121382 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.123320 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:57.123321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:57.123322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:57.123328 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:57.124578 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:57.124927 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:57.124928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:57.124928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:57.124978 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:57.125201 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:57.125201 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:57.125202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:57.125298 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:57.125348 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.125564 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.125635 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:28:57.125856 6858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.118069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:35107)
0811 14:28:57.118223 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.118263 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:57.118728 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:57.118931 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:57.118934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:57.119479 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:28:57.119666 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.119670 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.120311 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.120312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.121081 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.121083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.121400 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.121401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.121499 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.121901 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:28:57.121908 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:28:57.123233 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:28:57.124647 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:57.124653 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:57.124655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:57.124861 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:57.125036 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:28:57.125036 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:28:57.125037 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:28:57.125134 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:28:57.125352 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:28:57.125356 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:28:57.125459 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 14:28:57.125537 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:28:57.125645 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260811 14:28:57.125929 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6711
I20260811 14:28:57.126581 6856 heartbeater.cc:347] Connected to a master server at 127.20.132.254:34037
I20260811 14:28:57.126667 6856 heartbeater.cc:464] Registering TS with master...
I20260811 14:28:57.126854 6856 heartbeater.cc:511] Master 127.20.132.254:34037 requested a full tablet report, sending...
I20260811 14:28:57.127262 6330 ts_manager.cc:194] Registered new tserver with Master: ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023)
I20260811 14:28:57.127779 6330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:35107
I20260811 14:28:57.132495 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.126435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36020 (local address 127.20.132.254:34037)
0811 14:28:57.126480 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.126482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.126545 (+ 63us) server_negotiation.cc:407] Connection header received
0811 14:28:57.126632 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.126633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.126642 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.126695 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:57.127447 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.128072 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.128970 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.129153 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.129206 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.130255 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:57.130256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:57.130256 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:57.130262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:57.131463 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:57.131801 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:57.131802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:57.131802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:57.131849 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:57.132045 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:57.132045 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:57.132045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:57.132132 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:57.132317 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.132384 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.132440 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:28:57.133441 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:28:57.135908 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.133768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.20.132.254:34037)
0811 14:28:57.133825 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.133826 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.133979 (+ 153us) server_negotiation.cc:407] Connection header received
0811 14:28:57.134013 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.134014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.134042 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.134097 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:57.134196 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.134678 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.135349 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.135515 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.135566 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.135702 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:57.135738 (+ 36us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 14:28:57.135847 (+ 109us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36030: token expired
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 14:28:57.135967 6551 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36030: token expired
W20260811 14:28:57.136188 6251 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.132.254:34037)
I20260811 14:28:57.141789 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.136420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36038 (local address 127.20.132.254:34037)
0811 14:28:57.136468 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.136470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.136479 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:57.136547 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.136548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.136554 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.136601 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:28:57.137015 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.137430 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.138051 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.138214 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.138270 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.139260 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:28:57.139261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:28:57.139261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:28:57.139267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:28:57.140532 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:57.140924 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:57.140925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:57.140925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:57.140984 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:28:57.141275 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:28:57.141276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:28:57.141276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:28:57.141376 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:28:57.141481 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.141611 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.141688 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 14:28:57.142854 6330 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:28:57.144471 6330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:28:57.146812 6470 tablet_service.cc:1467] Processing CreateTablet for tablet 239486ae2267498c83ee3cb9745d15d7 (DEFAULT_TABLE table=test-table [id=76b97a08eee54138922ca8b333082928]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:57.147015 6470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239486ae2267498c83ee3cb9745d15d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:57.148551 6419 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Bootstrap starting.
I20260811 14:28:57.148874 6419 tablet_bootstrap.cc:654] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:57.149874 6419 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: No bootstrap required, opened a new log
I20260811 14:28:57.149931 6419 ts_tablet_manager.cc:1397] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:28:57.150107 6419 raft_consensus.cc:348] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.150182 6419 raft_consensus.cc:374] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:57.150230 6419 raft_consensus.cc:729] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee6afaec53442fb853e36e993b3c33b, State: Initialized, Role: FOLLOWER
I20260811 14:28:57.150276 6419 consensus_queue.cc:260] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.150372 6419 ts_tablet_manager.cc:1428] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 14:28:57.150575 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.146298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:38275 (local address 127.0.0.1:49752)
0811 14:28:57.146333 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.146343 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:57.146378 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:57.146978 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:57.146979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:57.146981 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:57.147022 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.147024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.148058 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.148059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.149235 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.149238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.150307 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.150308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.150388 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.150411 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 14:28:57.150465 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 14:28:57.150512 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 14:28:57.150761 6863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.146618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49752 (local address 127.20.132.194:38275)
0811 14:28:57.146781 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.146785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.146795 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:28:57.146839 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.146840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.146853 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.146954 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:57.147110 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.147962 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.149328 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.150084 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.150192 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.150253 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.150495 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.150534 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260811 14:28:57.151409 6633 tablet_service.cc:1467] Processing CreateTablet for tablet 239486ae2267498c83ee3cb9745d15d7 (DEFAULT_TABLE table=test-table [id=76b97a08eee54138922ca8b333082928]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:57.151763 6633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239486ae2267498c83ee3cb9745d15d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:57.151966 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.146408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36376 (local address 127.20.132.195:42023)
0811 14:28:57.146598 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.146603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.146618 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:28:57.148568 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.148571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.148587 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.148667 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:57.148869 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.149896 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.151090 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.151600 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.151670 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.151721 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.151842 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.151889 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260811 14:28:57.152040 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.146298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:42023 (local address 127.0.0.1:36376)
0811 14:28:57.146561 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.146572 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:57.146629 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:57.148757 (+ 2128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:57.148758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:57.148760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:57.148799 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.148800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.149993 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.149994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.151003 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.151006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.151671 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.151672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.151745 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.151748 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:57.151799 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 14:28:57.151960 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":125,"thread_start_us":77,"threads_started":1}
I20260811 14:28:57.154500 6865 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Bootstrap starting.
I20260811 14:28:57.155082 6783 tablet_service.cc:1467] Processing CreateTablet for tablet 239486ae2267498c83ee3cb9745d15d7 (DEFAULT_TABLE table=test-table [id=76b97a08eee54138922ca8b333082928]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:28:57.155231 6865 tablet_bootstrap.cc:654] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:57.155377 6783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239486ae2267498c83ee3cb9745d15d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:28:57.155800 6865 log.cc:824] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:57.156602 6865 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: No bootstrap required, opened a new log
I20260811 14:28:57.156658 6865 ts_tablet_manager.cc:1397] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:28:57.158011 6865 raft_consensus.cc:348] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.158211 6865 raft_consensus.cc:374] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:57.158259 6865 raft_consensus.cc:729] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc262a4ca674ad680490d106a1d3aa8, State: Initialized, Role: FOLLOWER
I20260811 14:28:57.158370 6867 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Bootstrap starting.
I20260811 14:28:57.158399 6865 consensus_queue.cc:260] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.158706 6865 ts_tablet_manager.cc:1428] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:28:57.158735 6707 heartbeater.cc:503] Master 127.20.132.254:34037 was elected leader, sending a full tablet report...
I20260811 14:28:57.159029 6867 tablet_bootstrap.cc:654] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Neither blocks nor log segments found. Creating new log.
I20260811 14:28:57.159590 6867 log.cc:824] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:28:57.160368 6867 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: No bootstrap required, opened a new log
I20260811 14:28:57.160423 6867 ts_tablet_manager.cc:1397] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:28:57.161677 6867 raft_consensus.cc:348] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.161824 6867 raft_consensus.cc:374] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:28:57.161849 6867 raft_consensus.cc:729] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8e9065d02646f1945de055d1803d3c, State: Initialized, Role: FOLLOWER
I20260811 14:28:57.161957 6867 consensus_queue.cc:260] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.162171 6867 ts_tablet_manager.cc:1428] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:28:57.162222 6856 heartbeater.cc:503] Master 127.20.132.254:34037 was elected leader, sending a full tablet report...
W20260811 14:28:57.233314 6708 tablet.cc:2369] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:28:57.326129 6548 tablet.cc:2369] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:28:57.367925 6857 tablet.cc:2369] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:28:57.406874 6870 raft_consensus.cc:482] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:28:57.407019 6870 raft_consensus.cc:504] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.407478 6870 leader_election.cc:288] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275), cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
I20260811 14:28:57.410516 6874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.407812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:57863 (local address 127.20.132.193:38049)
0811 14:28:57.407944 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.407947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.407956 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:28:57.407989 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.407989 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.408021 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.408102 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:57.408297 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.408792 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.409752 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.410156 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.410261 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.410339 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.410391 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.410433 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260811 14:28:57.410516 6858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.407703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.20.132.195:57863)
0811 14:28:57.407758 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.407772 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:57.407823 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:57.408118 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:57.408119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:57.408120 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:57.408218 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.408220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.408886 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.408887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.409638 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.409640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.410244 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.410245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.410319 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.410322 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:57.410376 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 14:28:57.410416 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 14:28:57.410532 6863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.407784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:57019 (local address 127.20.132.194:38275)
0811 14:28:57.407829 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.407832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.408008 (+ 176us) server_negotiation.cc:407] Connection header received
0811 14:28:57.408044 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.408045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.408056 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.408135 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:28:57.408339 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.408800 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.409783 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.410173 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.410268 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.410278 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.410421 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.410463 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:28:57.410612 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.407704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:38275 (local address 127.20.132.195:57019)
0811 14:28:57.407921 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.407932 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:28:57.407992 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:28:57.408164 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:28:57.408165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:28:57.408167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:28:57.408258 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.408259 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.408883 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.408884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.409682 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:28:57.409684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.410268 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.410269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:28:57.410345 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.410348 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:28:57.410415 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 14:28:57.410452 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":78,"thread_start_us":113,"threads_started":1}
I20260811 14:28:57.410890 6491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239486ae2267498c83ee3cb9745d15d7" candidate_uuid: "ac8e9065d02646f1945de055d1803d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee6afaec53442fb853e36e993b3c33b" is_pre_election: true
I20260811 14:28:57.410950 6657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239486ae2267498c83ee3cb9745d15d7" candidate_uuid: "ac8e9065d02646f1945de055d1803d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc262a4ca674ad680490d106a1d3aa8" is_pre_election: true
I20260811 14:28:57.411058 6491 raft_consensus.cc:2454] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8e9065d02646f1945de055d1803d3c in term 0.
I20260811 14:28:57.411070 6657 raft_consensus.cc:2454] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8e9065d02646f1945de055d1803d3c in term 0.
I20260811 14:28:57.411329 6732 leader_election.cc:302] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc262a4ca674ad680490d106a1d3aa8, ac8e9065d02646f1945de055d1803d3c; no voters:
I20260811 14:28:57.411468 6870 raft_consensus.cc:2781] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:28:57.411525 6870 raft_consensus.cc:482] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:28:57.411546 6870 raft_consensus.cc:3037] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:57.412370 6870 raft_consensus.cc:504] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.412514 6870 leader_election.cc:288] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [CANDIDATE]: Term 1 election: Requested vote from peers 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275), cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
I20260811 14:28:57.412688 6657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239486ae2267498c83ee3cb9745d15d7" candidate_uuid: "ac8e9065d02646f1945de055d1803d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc262a4ca674ad680490d106a1d3aa8"
I20260811 14:28:57.412724 6491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239486ae2267498c83ee3cb9745d15d7" candidate_uuid: "ac8e9065d02646f1945de055d1803d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee6afaec53442fb853e36e993b3c33b"
I20260811 14:28:57.412789 6657 raft_consensus.cc:3037] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:57.412797 6491 raft_consensus.cc:3037] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:28:57.413482 6491 raft_consensus.cc:2454] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8e9065d02646f1945de055d1803d3c in term 1.
I20260811 14:28:57.413590 6657 raft_consensus.cc:2454] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8e9065d02646f1945de055d1803d3c in term 1.
I20260811 14:28:57.413707 6731 leader_election.cc:302] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac8e9065d02646f1945de055d1803d3c, cee6afaec53442fb853e36e993b3c33b; no voters:
I20260811 14:28:57.413805 6870 raft_consensus.cc:2781] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:28:57.413944 6870 raft_consensus.cc:686] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 1 LEADER]: Becoming Leader. State: Replica: ac8e9065d02646f1945de055d1803d3c, State: Running, Role: LEADER
I20260811 14:28:57.414136 6870 consensus_queue.cc:237] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:28:57.415040 6330 catalog_manager.cc:5495] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to ac8e9065d02646f1945de055d1803d3c (127.20.132.195). New cstate: current_term: 1 leader_uuid: "ac8e9065d02646f1945de055d1803d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } health_report { overall_health: UNKNOWN } } }
I20260811 14:28:57.432545 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.430159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36388 (local address 127.20.132.195:42023)
0811 14:28:57.430217 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:28:57.430219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:28:57.430227 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:28:57.430267 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:28:57.430268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:28:57.430291 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:28:57.430372 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:28:57.430482 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.430957 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.431685 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:28:57.431892 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:28:57.431970 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:28:57.432187 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:28:57.432287 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:28:57.432385 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 14:28:57.432405 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 14:28:57.432426 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 14:28:57.434504 6657 raft_consensus.cc:1261] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Refusing update from remote peer ac8e9065d02646f1945de055d1803d3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:57.434830 6491 raft_consensus.cc:1261] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Refusing update from remote peer ac8e9065d02646f1945de055d1803d3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:28:57.434857 6875 consensus_queue.cc:1035] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:57.435110 6870 consensus_queue.cc:1035] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:28:57.437567 6880 mvcc.cc:205] Tried to move back new op lower bound from 7317334169328599040 to 7317334169248915456. Current Snapshot: MvccSnapshot[applied={T|T < 7317334169328599040}]
I20260811 14:28:57.439504 6330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:57.439601 6330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:28:57.440399 6330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Sending DeleteTablet for 3 replicas of tablet 239486ae2267498c83ee3cb9745d15d7
I20260811 14:28:57.440704 6633 tablet_service.cc:1514] Processing DeleteTablet for tablet 239486ae2267498c83ee3cb9745d15d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:57 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49752
I20260811 14:28:57.440766 6470 tablet_service.cc:1514] Processing DeleteTablet for tablet 239486ae2267498c83ee3cb9745d15d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:57 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:58070
I20260811 14:28:57.440786 6783 tablet_service.cc:1514] Processing DeleteTablet for tablet 239486ae2267498c83ee3cb9745d15d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:28:57 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36376
I20260811 14:28:57.440984 6891 tablet_replica.cc:330] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: stopping tablet replica
I20260811 14:28:57.441045 6891 raft_consensus.cc:2229] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:57.441087 6889 tablet_replica.cc:330] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: stopping tablet replica
I20260811 14:28:57.441184 6889 raft_consensus.cc:2229] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:28:57.441182 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 6374
I20260811 14:28:57.441094 6891 raft_consensus.cc:2258] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:57.446187 6893 tablet_replica.cc:330] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: stopping tablet replica
I20260811 14:28:57.446303 6893 raft_consensus.cc:2229] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:28:57.446413 6893 raft_consensus.cc:2258] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:28:57.447154 6893 ts_tablet_manager.cc:1905] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:28:57.451009 6893 ts_tablet_manager.cc:1918] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:28:57.451121 6893 log.cc:1196] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/239486ae2267498c83ee3cb9745d15d7
I20260811 14:28:57.451457 6893 ts_tablet_manager.cc:1939] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Deleting consensus metadata
I20260811 14:28:57.451975 6314 catalog_manager.cc:4841] TS ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023): tablet 239486ae2267498c83ee3cb9745d15d7 (table test-table [id=76b97a08eee54138922ca8b333082928]) successfully deleted
W20260811 14:28:57.452940 6314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:38049 (error 108)
I20260811 14:28:57.453423 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 6553
I20260811 14:28:57.453459 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:28:57.453299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.0.0.1:58074)
0811 14:28:57.453370 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.453420 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:38049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 14:28:57.454568 6314 catalog_manager.cc:4584] TS cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 239486ae2267498c83ee3cb9745d15d7: Network error: Client connection negotiation failed: client connection to 127.20.132.193:38049: connect: Connection refused (error 111)
W20260811 14:28:57.462535 6861 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:28:57.462398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:38275 (local address 127.0.0.1:49762)
0811 14:28:57.462461 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 14:28:57.462497 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.194:38275: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 14:28:57.462849 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 6711
I20260811 14:28:57.469480 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 6292
I20260811 14:29:17.476751 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34037
--webserver_interface=127.20.132.254
--webserver_port=42597
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:34037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:17.558336 6895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:17.558563 6895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:17.558604 6895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:17.559737 6895 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 14:29:17.559803 6895 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 14:29:17.559824 6895 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 14:29:17.559841 6895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:17.559870 6895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:17.559900 6895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:17.559931 6895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:17.559962 6895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:17.561488 6895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:34037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:34037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=42597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:17.561757 6895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:17.562018 6895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:17.566920 6904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.566916 6902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.566927 6901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:17.567198 6895 server_base.cc:1034] running on GCE node
I20260811 14:29:17.567497 6895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:17.567833 6895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:17.568981 6895 hybrid_clock.cc:648] HybridClock initialized: now 1786458557568959 us; error 36 us; skew 500 ppm
Aug 11 14:29:17 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:17.581687 6895 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:29:17.582203 6895 webserver.cc:460] Webserver started at http://127.20.132.254:42597/ using document root <none> and password file <none>
I20260811 14:29:17.582460 6895 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:17.582509 6895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:17.583904 6895 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:17.584662 6912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:17.584854 6895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:29:17.584947 6895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "73dab259b13b4747a9e1e38932a0ed61"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "8104c302f99ab235080c1a175e95cbee"
server_key_iv: "2d33398655a15b72243bb26a9a665c1f"
server_key_version: "encryptionkey@0"
I20260811 14:29:17.585309 6895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:17.604604 6895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:17.606520 6895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:17.606673 6895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:17.610803 6895 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:34037
I20260811 14:29:17.610855 6969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:34037 every 8 connection(s)
I20260811 14:29:17.611233 6895 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:17.612438 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6895
I20260811 14:29:17.612762 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:38049
--local_ip_for_outbound_sockets=127.20.132.193
--tserver_master_addrs=127.20.132.254:34037
--webserver_port=35529
--webserver_interface=127.20.132.193
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:29:17.613036 6970 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:29:17.614104 6970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap starting.
I20260811 14:29:17.622902 6970 log.cc:824] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:17.625172 6970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:29:17.625489 6970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: Bootstrap complete.
I20260811 14:29:17.627888 6970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:29:17.628139 6970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73dab259b13b4747a9e1e38932a0ed61, State: Initialized, Role: FOLLOWER
I20260811 14:29:17.628348 6970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:29:17.628427 6970 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:17.628481 6970 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:17.628533 6970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 2 FOLLOWER]: Advancing to term 3
I20260811 14:29:17.629588 6970 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:29:17.629706 6970 leader_election.cc:302] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73dab259b13b4747a9e1e38932a0ed61; no voters:
I20260811 14:29:17.629906 6970 leader_election.cc:288] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 14:29:17.629946 6976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 14:29:17.630066 6976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [term 3 LEADER]: Becoming Leader. State: Replica: 73dab259b13b4747a9e1e38932a0ed61, State: Running, Role: LEADER
I20260811 14:29:17.630152 6976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } }
I20260811 14:29:17.630178 6970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:17.630426 6976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73dab259b13b4747a9e1e38932a0ed61. Latest consensus state: current_term: 3 leader_uuid: "73dab259b13b4747a9e1e38932a0ed61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } } }
I20260811 14:29:17.630505 6976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:17.630430 6978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "73dab259b13b4747a9e1e38932a0ed61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73dab259b13b4747a9e1e38932a0ed61" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 34037 } } }
I20260811 14:29:17.630671 6978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:17.631978 6993 catalog_manager.cc:1259] Loaded cluster ID: 396d0e505f5b40659537d3bf72441905
I20260811 14:29:17.632056 6993 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: loading cluster ID for follower catalog manager: success
I20260811 14:29:17.632911 6993 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 73dab259b13b4747a9e1e38932a0ed61: acquiring CA information for follower catalog manager: success
F20260811 14:29:17.633251 6993 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe777eb49ad google::LogMessage::Fail() at ??:0
@ 0x7fe777eb788a google::LogMessage::SendToLog() at ??:0
@ 0x7fe777eb44de google::LogMessage::Flush() at ??:0
@ 0x7fe777eb5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe77a621104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe77fe0d6b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7fe77fe0d989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7fe77fe0de4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7fe77fe108c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7fe779d77954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe77abdb6db start_thread at ??:0
@ 0x7fe7769b261f clone at ??:0
W20260811 14:29:17.708587 6973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:17.708778 6973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:17.708801 6973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:17.709971 6973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:17.710014 6973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:17.710040 6973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:17.711463 6973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:38049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=35529
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:17.711704 6973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:17.711944 6973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:17.717031 7014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:17.717064 6973 server_base.cc:1034] running on GCE node
W20260811 14:29:17.717031 7016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.717306 7013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:17.717547 6973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:17.717799 6973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:17.718962 6973 hybrid_clock.cc:648] HybridClock initialized: now 1786458557718946 us; error 34 us; skew 500 ppm
Aug 11 14:29:17 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:17.721625 6973 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:29:17.722131 6973 webserver.cc:460] Webserver started at http://127.20.132.193:35529/ using document root <none> and password file <none>
I20260811 14:29:17.722381 6973 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:17.722451 6973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:17.723822 6973 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:17.724593 7023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:17.724747 6973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:17.724853 6973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "cee6afaec53442fb853e36e993b3c33b"
format_stamp: "Formatted at 2026-08-11 14:28:35 on dist-test-slave-cbbz"
server_key: "f04b4c4e730a9c41118f5956de5bc15f"
server_key_iv: "c6416715f45b6b6f07144147f3900b00"
server_key_version: "encryptionkey@0"
I20260811 14:29:17.725207 6973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:17.748554 6973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:17.750775 6973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:17.750957 6973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:17.751216 6973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:17.751686 7030 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 14:29:17.753707 6973 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 14:29:17.753772 6973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 14:29:17.753813 6973 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 14:29:17.754457 6973 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 14:29:17.754511 6973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 14:29:17.754587 7030 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Bootstrap starting.
I20260811 14:29:17.762141 6973 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:38049
I20260811 14:29:17.762522 6973 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:29:17.763087 7151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:38049 every 8 connection(s)
I20260811 14:29:17.766552 7030 log.cc:824] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:17.768848 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 6973
I20260811 14:29:17.769142 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:38275
--local_ip_for_outbound_sockets=127.20.132.194
--tserver_master_addrs=127.20.132.254:34037
--webserver_port=46757
--webserver_interface=127.20.132.194
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:29:17.769263 7030 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:29:17.769572 7030 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Bootstrap complete.
I20260811 14:29:17.770970 7030 ts_tablet_manager.cc:1397] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260811 14:29:17.772542 7030 raft_consensus.cc:348] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:17.772861 7030 raft_consensus.cc:729] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee6afaec53442fb853e36e993b3c33b, State: Initialized, Role: FOLLOWER
I20260811 14:29:17.773001 7030 consensus_queue.cc:260] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:17.773272 7030 ts_tablet_manager.cc:1428] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260811 14:29:17.826874 7155 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:29:17.763249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:43587)
0811 14:29:17.763431 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.763475 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:17.763930 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:17.826659 (+ 62729us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":108,"threads_started":1}
W20260811 14:29:17.827186 7152 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:34037 (0 consecutive failures): Network error: Failed to ping master at 127.20.132.254:34037: Client connection negotiation failed: client connection to 127.20.132.254:34037: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 14:29:17.827579 7155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.827448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:33339)
0811 14:29:17.827502 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.827553 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 14:29:17.827946 7155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.827855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:56431)
0811 14:29:17.827900 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.827926 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:29:17.828085 7152 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:29:17.854287 7157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:17.854480 7157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:17.854503 7157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:17.855669 7157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:17.855710 7157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:17.855764 7157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:17.857263 7157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:38275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=46757
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:17.857498 7157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:17.857723 7157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:17.862625 7164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.862615 7163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.862617 7166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:17.862870 7157 server_base.cc:1034] running on GCE node
I20260811 14:29:17.863096 7157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:17.863364 7157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:17.864516 7157 hybrid_clock.cc:648] HybridClock initialized: now 1786458557864508 us; error 33 us; skew 500 ppm
Aug 11 14:29:17 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:17.866942 7157 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:29:17.867396 7157 webserver.cc:460] Webserver started at http://127.20.132.194:46757/ using document root <none> and password file <none>
I20260811 14:29:17.867617 7157 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:17.867689 7157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:17.869045 7157 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:17.869688 7174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:17.869861 7157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:17.869966 7157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "1dc262a4ca674ad680490d106a1d3aa8"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "b328acd37ec7c0c6ac452dbeef3917dc"
server_key_iv: "ff0270b3a54edef47cdeaa04e1582fb7"
server_key_version: "encryptionkey@0"
I20260811 14:29:17.870306 7157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:17.889046 7157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:17.890897 7157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:17.891065 7157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:17.891299 7157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:17.891772 7181 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 14:29:17.893177 7157 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 14:29:17.893239 7157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 14:29:17.893286 7157 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 14:29:17.893918 7157 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 14:29:17.893975 7157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 14:29:17.894026 7181 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Bootstrap starting.
I20260811 14:29:17.901285 7157 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:38275
I20260811 14:29:17.901396 7303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:38275 every 8 connection(s)
I20260811 14:29:17.901724 7157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:29:17.902933 7306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.902428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:49985)
0811 14:29:17.902619 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.902731 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
W20260811 14:29:17.903195 7304 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:34037 (0 consecutive failures): Network error: Failed to ping master at 127.20.132.254:34037: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
I20260811 14:29:17.903510 7306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.903410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:52145)
0811 14:29:17.903461 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.903489 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:29:17.903806 7306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.903750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:36629)
0811 14:29:17.903774 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.903794 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 14:29:17.903927 7304 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 14:29:17.904428 7181 log.cc:824] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:17.904810 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 7157
I20260811 14:29:17.905135 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:42023
--local_ip_for_outbound_sockets=127.20.132.195
--tserver_master_addrs=127.20.132.254:34037
--webserver_port=36377
--webserver_interface=127.20.132.195
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:29:17.907168 7181 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:29:17.907462 7181 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Bootstrap complete.
I20260811 14:29:17.908710 7181 ts_tablet_manager.cc:1397] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260811 14:29:17.910946 7181 raft_consensus.cc:348] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:17.911352 7181 raft_consensus.cc:729] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc262a4ca674ad680490d106a1d3aa8, State: Initialized, Role: FOLLOWER
I20260811 14:29:17.911510 7181 consensus_queue.cc:260] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:17.911805 7181 ts_tablet_manager.cc:1428] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:29:17.912003 7306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.911919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:43523)
0811 14:29:17.911951 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.911978 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 14:29:17.912360 7306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:17.912270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:51795)
0811 14:29:17.912315 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:17.912338 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 14:29:17.989576 7308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:17.989838 7308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:17.989879 7308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:17.991030 7308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:17.991103 7308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:17.991149 7308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:17.992637 7308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:42023
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=36377
--tserver_master_addrs=127.20.132.254:34037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:17.992913 7308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:17.993151 7308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:17.998240 7319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.998373 7316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:17.998265 7315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:17.998502 7308 server_base.cc:1034] running on GCE node
I20260811 14:29:17.998759 7308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:17.999014 7308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:18.000178 7308 hybrid_clock.cc:648] HybridClock initialized: now 1786458558000170 us; error 31 us; skew 500 ppm
Aug 11 14:29:17 dist-test-slave-cbbz krb5kdc[5683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:18.002750 7308 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:29:18.003216 7308 webserver.cc:460] Webserver started at http://127.20.132.195:36377/ using document root <none> and password file <none>
I20260811 14:29:18.003403 7308 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:18.003444 7308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:18.004823 7308 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:18.005358 7326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:18.005532 7308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:18.005637 7308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "ac8e9065d02646f1945de055d1803d3c"
format_stamp: "Formatted at 2026-08-11 14:28:36 on dist-test-slave-cbbz"
server_key: "a58bb41991e7baed05211dedc4023657"
server_key_iv: "a62e90761930cc55f03fce2fab5006d2"
server_key_version: "encryptionkey@0"
I20260811 14:29:18.005975 7308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:18.018781 7308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:18.021099 7308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:18.021268 7308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:18.021487 7308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:18.021807 7308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:18.021869 7308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:18.021910 7308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:18.021938 7308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:18.028110 7308 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:42023
I20260811 14:29:18.028219 7448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:42023 every 8 connection(s)
I20260811 14:29:18.028576 7308 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:29:18.029655 7451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.029283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:49185)
0811 14:29:18.029443 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.029514 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
W20260811 14:29:18.030088 7449 heartbeater.cc:644] Failed to heartbeat to 127.20.132.254:34037 (0 consecutive failures): Network error: Failed to ping master at 127.20.132.254:34037: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
I20260811 14:29:18.030369 7451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.030280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:32863)
0811 14:29:18.030325 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.030352 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 14:29:18.030658 7451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.030585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:41471)
0811 14:29:18.030624 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.030645 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 14:29:18.030783 7449 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 14:29:18.031226 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 7308
I20260811 14:29:18.828715 7453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.828463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:46313)
0811 14:29:18.828604 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.828645 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
I20260811 14:29:18.908316 7455 raft_consensus.cc:482] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:18.908573 7455 raft_consensus.cc:504] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:18.908912 7455 leader_election.cc:288] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275), ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023)
I20260811 14:29:18.912973 7459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.912734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:34547)
0811 14:29:18.912851 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.912922 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":46,"threads_started":1}
Aug 11 14:29:18 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.194@KRBTEST.COM
Aug 11 14:29:18 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.195@KRBTEST.COM
I20260811 14:29:18.919436 7457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.909227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:58725 (local address 127.20.132.194:38275)
0811 14:29:18.909384 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:18.909394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:18.909414 (+ 20us) server_negotiation.cc:407] Connection header received
0811 14:29:18.909542 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:18.909544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:18.909597 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:18.909703 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:18.910507 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.911387 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.912655 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.913199 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.913294 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:18.915863 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:18.915867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:18.915867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:18.915880 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:18.917628 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:18.918088 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:18.918090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:18.918091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:18.918172 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:18.918476 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:18.918477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:18.918477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:18.918799 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:18.918860 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:18.919219 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 14:29:18.919321 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":57,"threads_started":1}
I20260811 14:29:18.919452 7453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.909103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:38275 (local address 127.20.132.193:58725)
0811 14:29:18.909160 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.909172 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:18.909225 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:18.909762 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:18.909765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:18.910150 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:18.910393 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:18.910399 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.911586 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.911587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:18.912459 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:18.912462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.913273 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.913274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:18.913388 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:18.914029 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:18.914033 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:18.915754 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:18.917712 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:18.917719 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:18.917721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:18.917998 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:18.918237 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:18.918238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:18.918239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:18.918390 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:18.918873 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:18.918880 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:18.919050 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 14:29:18.919181 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 14:29:18.919338 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":55}
I20260811 14:29:18.919751 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.909103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:42023 (local address 127.20.132.193:60197)
0811 14:29:18.909237 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.909249 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:18.909316 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:18.910202 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:18.910203 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:18.910369 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:18.910426 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:18.910428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.911637 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.911638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:18.912462 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:18.912464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.913252 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.913253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:18.913388 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:18.914004 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:18.914026 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:18.916253 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:18.918408 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:18.918409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:18.918409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:18.918660 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:18.918921 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:18.918922 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:18.918922 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:18.918975 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:18.919421 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:18.919422 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:18.919469 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 14:29:18.919547 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:29:18.919664 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":17,"thread_start_us":47,"threads_started":1}
I20260811 14:29:18.919945 7252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239486ae2267498c83ee3cb9745d15d7" candidate_uuid: "cee6afaec53442fb853e36e993b3c33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1dc262a4ca674ad680490d106a1d3aa8" is_pre_election: true
I20260811 14:29:18.920094 7252 raft_consensus.cc:2454] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cee6afaec53442fb853e36e993b3c33b in term 1.
I20260811 14:29:18.920106 7458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.909255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:60197 (local address 127.20.132.195:42023)
0811 14:29:18.909384 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:18.909394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:18.909422 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:29:18.910004 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:18.910008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:18.910074 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:18.910210 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:18.910569 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.911544 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.912554 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:18.913151 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:18.913279 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:18.916350 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:18.916354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:18.916355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:18.916367 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:18.918334 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:18.918746 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:18.918748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:18.918748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:18.918823 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:18.919038 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:18.919039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:18.919039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:18.919337 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:18.919417 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:18.919918 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 14:29:18.920033 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":66,"threads_started":1}
I20260811 14:29:18.920433 7027 leader_election.cc:302] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc262a4ca674ad680490d106a1d3aa8, cee6afaec53442fb853e36e993b3c33b; no voters:
I20260811 14:29:18.920557 7455 raft_consensus.cc:2781] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 14:29:18.920653 7455 raft_consensus.cc:482] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:18.920682 7455 raft_consensus.cc:3037] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 1 FOLLOWER]: Advancing to term 2
W20260811 14:29:18.920815 7026 leader_election.cc:341] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023): Not found: Tablet not found: 239486ae2267498c83ee3cb9745d15d7
I20260811 14:29:18.921872 7455 raft_consensus.cc:504] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:18.922020 7455 leader_election.cc:288] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [CANDIDATE]: Term 2 election: Requested vote from peers 1dc262a4ca674ad680490d106a1d3aa8 (127.20.132.194:38275), ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023)
W20260811 14:29:18.922333 7026 leader_election.cc:341] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023): Not found: Tablet not found: 239486ae2267498c83ee3cb9745d15d7
I20260811 14:29:18.922369 7252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239486ae2267498c83ee3cb9745d15d7" candidate_uuid: "cee6afaec53442fb853e36e993b3c33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1dc262a4ca674ad680490d106a1d3aa8"
I20260811 14:29:18.922448 7252 raft_consensus.cc:3037] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:29:18.923590 7252 raft_consensus.cc:2454] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cee6afaec53442fb853e36e993b3c33b in term 2.
I20260811 14:29:18.923823 7027 leader_election.cc:302] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dc262a4ca674ad680490d106a1d3aa8, cee6afaec53442fb853e36e993b3c33b; no voters: ac8e9065d02646f1945de055d1803d3c
I20260811 14:29:18.923918 7455 raft_consensus.cc:2781] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:29:18.924054 7455 raft_consensus.cc:686] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [term 2 LEADER]: Becoming Leader. State: Replica: cee6afaec53442fb853e36e993b3c33b, State: Running, Role: LEADER
I20260811 14:29:18.924199 7455 consensus_queue.cc:237] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:18.924353 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:18.924243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:36913)
0811 14:29:18.924297 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:18.924331 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 14:29:19.031320 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:19.031130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:35037)
0811 14:29:19.031244 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:19.031286 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260811 14:29:19.377765 7252 raft_consensus.cc:1261] T 239486ae2267498c83ee3cb9745d15d7 P 1dc262a4ca674ad680490d106a1d3aa8 [term 2 FOLLOWER]: Refusing update from remote peer cee6afaec53442fb853e36e993b3c33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 14:29:19.378186 7455 consensus_queue.cc:1035] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 14:29:19.379119 7459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:19.379000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:51127)
0811 14:29:19.379056 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:19.379089 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 14:29:19.380082 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:19.379966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:40317)
0811 14:29:19.380002 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:19.380031 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 14:29:19.380101 7459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:19.379996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:58081)
0811 14:29:19.380030 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:19.380073 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 14:29:19.380185 7026 consensus_peers.cc:487] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b -> Peer ac8e9065d02646f1945de055d1803d3c (127.20.132.195:42023): Couldn't send request to peer ac8e9065d02646f1945de055d1803d3c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 239486ae2267498c83ee3cb9745d15d7. This is attempt 1: this message will repeat every 5th retry.
I20260811 14:29:19.981628 7468 ts_tablet_manager.cc:927] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Initiating tablet copy from peer cee6afaec53442fb853e36e993b3c33b (127.20.132.193:38049)
I20260811 14:29:19.981935 7468 tablet_copy_client.cc:316] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: tablet copy: Beginning tablet copy session from remote peer at address 127.20.132.193:38049
Aug 11 14:29:19 dist-test-slave-cbbz krb5kdc[5683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458557, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.193@KRBTEST.COM
I20260811 14:29:19.989873 7472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:19.982404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:53707 (local address 127.20.132.193:38049)
0811 14:29:19.982549 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:19.982555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:19.982617 (+ 62us) server_negotiation.cc:407] Connection header received
0811 14:29:19.982644 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:19.982645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:19.982658 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:19.982726 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:19.983199 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:19.983904 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:19.984736 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:19.985043 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:19.985110 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:19.987095 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:19.987103 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:19.987103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:19.987110 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:19.988843 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:19.989178 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:19.989180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:19.989181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:19.989236 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:19.989402 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:19.989402 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:19.989403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:19.989538 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:19.989612 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:19.989735 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 14:29:19.989800 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260811 14:29:19.989885 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:19.982292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38049 (local address 127.20.132.195:53707)
0811 14:29:19.982458 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:19.982476 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:19.982562 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:19.982745 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:19.982750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:19.983036 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:19.983117 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:19.983119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:19.983999 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:19.984000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:19.984647 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:19.984650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:19.985118 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:19.985119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:19.985182 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:19.985676 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:19.985680 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:19.987009 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:19.988913 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:19.988918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:19.988920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:19.989106 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:19.989295 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:19.989296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:19.989296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:19.989349 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:19.989605 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:19.989610 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:19.989651 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 14:29:19.989714 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:29:19.989801 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
I20260811 14:29:19.990343 7123 tablet_copy_service.cc:140] P cee6afaec53442fb853e36e993b3c33b: Received BeginTabletCopySession request for tablet 239486ae2267498c83ee3cb9745d15d7 from peer ac8e9065d02646f1945de055d1803d3c ({username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:53707)
I20260811 14:29:19.990407 7123 tablet_copy_service.cc:161] P cee6afaec53442fb853e36e993b3c33b: Beginning new tablet copy session on tablet 239486ae2267498c83ee3cb9745d15d7 from peer ac8e9065d02646f1945de055d1803d3c at {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:53707: session id = ac8e9065d02646f1945de055d1803d3c-239486ae2267498c83ee3cb9745d15d7
I20260811 14:29:19.990906 7123 tablet_copy_source_session.cc:205] T 239486ae2267498c83ee3cb9745d15d7 P cee6afaec53442fb853e36e993b3c33b: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 14:29:19.991873 7468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239486ae2267498c83ee3cb9745d15d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:19.994635 7468 tablet_copy_client.cc:791] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: tablet copy: Starting download of 0 data blocks...
I20260811 14:29:19.994804 7468 tablet_copy_client.cc:655] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: tablet copy: Starting download of 1 WAL segments...
I20260811 14:29:19.995616 7468 tablet_copy_client.cc:531] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 14:29:19.996392 7468 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Bootstrap starting.
I20260811 14:29:19.997750 7468 log.cc:824] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:20.000547 7468 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:29:20.000795 7468 tablet_bootstrap.cc:492] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Bootstrap complete.
I20260811 14:29:20.000942 7468 ts_tablet_manager.cc:1397] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260811 14:29:20.002015 7468 raft_consensus.cc:348] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:20.002166 7468 raft_consensus.cc:729] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8e9065d02646f1945de055d1803d3c, State: Initialized, Role: FOLLOWER
I20260811 14:29:20.002305 7468 consensus_queue.cc:260] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc262a4ca674ad680490d106a1d3aa8" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 38275 } } peers { permanent_uuid: "ac8e9065d02646f1945de055d1803d3c" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 42023 } } peers { permanent_uuid: "cee6afaec53442fb853e36e993b3c33b" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38049 } }
I20260811 14:29:20.002614 7468 ts_tablet_manager.cc:1428] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 14:29:20.002903 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:20.002775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:35411)
0811 14:29:20.002836 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:20.002866 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 14:29:20.003017 7123 tablet_copy_service.cc:342] P cee6afaec53442fb853e36e993b3c33b: Request end of tablet copy session ac8e9065d02646f1945de055d1803d3c-239486ae2267498c83ee3cb9745d15d7 received from {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:53707
I20260811 14:29:20.003085 7123 tablet_copy_service.cc:433] P cee6afaec53442fb853e36e993b3c33b: ending tablet copy session ac8e9065d02646f1945de055d1803d3c-239486ae2267498c83ee3cb9745d15d7 on tablet 239486ae2267498c83ee3cb9745d15d7 with peer ac8e9065d02646f1945de055d1803d3c
I20260811 14:29:20.003216 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:20.003122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:51657)
0811 14:29:20.003160 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:20.003192 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 14:29:20.380770 7475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:20.380555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:36981)
0811 14:29:20.380679 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:20.380719 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260811 14:29:20.380846 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:20.380626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:33759)
0811 14:29:20.380755 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:20.380801 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260811 14:29:20.487478 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:20.487329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:46267)
0811 14:29:20.487387 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:20.487423 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 14:29:20.487561 7400 raft_consensus.cc:1203] T 239486ae2267498c83ee3cb9745d15d7 P ac8e9065d02646f1945de055d1803d3c [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260811 14:29:20.488078 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:20.487898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:38101)
0811 14:29:20.487969 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:20.488007 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 14:29:21.381587 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:21.381338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:55195)
0811 14:29:21.381496 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:21.381538 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":66,"threads_started":1}
I20260811 14:29:21.488260 7482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:21.487952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:47711)
0811 14:29:21.488160 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:21.488198 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
I20260811 14:29:21.488726 7484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:21.488507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:42429)
0811 14:29:21.488644 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:21.488674 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260811 14:29:22.382320 7485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:22.382075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:48369)
0811 14:29:22.382234 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:22.382273 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":84,"threads_started":1}
I20260811 14:29:22.488999 7486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:22.488757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:47081)
0811 14:29:22.488899 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:22.488929 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260811 14:29:22.489355 7487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:22.489127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:33743)
0811 14:29:22.489284 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:22.489319 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260811 14:29:23.383056 7488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:23.382823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:44993)
0811 14:29:23.382970 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:23.383008 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":62,"threads_started":1}
I20260811 14:29:23.489845 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:23.489518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:33899)
0811 14:29:23.489738 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:23.489782 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":132,"threads_started":1}
I20260811 14:29:23.490100 7490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:23.489843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:50979)
0811 14:29:23.489982 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:23.490047 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
I20260811 14:29:23.490355 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:23.490259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:58365)
0811 14:29:23.490296 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:23.490327 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 14:29:24.383889 7491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:24.383585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:34065)
0811 14:29:24.383781 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:24.383835 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":83,"threads_started":1}
I20260811 14:29:24.490854 7492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:24.490611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:36143)
0811 14:29:24.490774 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:24.490807 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260811 14:29:24.491025 7493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:24.490795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:60611)
0811 14:29:24.490922 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:24.490972 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":74,"threads_started":1}
I20260811 14:29:25.384620 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:25.384406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:51437)
0811 14:29:25.384532 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:25.384570 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260811 14:29:25.491567 7495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:25.491352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:56175)
0811 14:29:25.491493 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:25.491520 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":72,"threads_started":1}
I20260811 14:29:25.491637 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:25.491431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:53501)
0811 14:29:25.491558 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:25.491596 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":85,"threads_started":1}
I20260811 14:29:26.385456 7497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:26.385222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:33021)
0811 14:29:26.385358 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:26.385406 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260811 14:29:26.492448 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:26.492220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:53979)
0811 14:29:26.492363 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:26.492401 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260811 14:29:26.492456 7500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:26.492220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:54205)
0811 14:29:26.492378 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:26.492415 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260811 14:29:27.386201 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:27.385963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:55609)
0811 14:29:27.386108 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:27.386148 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":64,"threads_started":1}
I20260811 14:29:27.493182 7502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:27.492953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:37619)
0811 14:29:27.493098 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:27.493134 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260811 14:29:27.493225 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:27.493007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:59317)
0811 14:29:27.493151 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:27.493183 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":60,"threads_started":1}
I20260811 14:29:28.387049 7504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:28.386779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:37903)
0811 14:29:28.386952 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:28.386998 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":81,"threads_started":1}
I20260811 14:29:28.493914 7510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:28.493683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:56553)
0811 14:29:28.493839 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:28.493866 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260811 14:29:28.493913 7505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:28.493700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:56905)
0811 14:29:28.493831 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:28.493870 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260811 14:29:29.387741 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:29.387527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:37035)
0811 14:29:29.387656 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:29.387693 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 14:29:29.494609 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:29.494383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:41271)
0811 14:29:29.494535 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:29.494564 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260811 14:29:29.494655 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:29.494447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:59895)
0811 14:29:29.494580 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:29.494613 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260811 14:29:30.388625 7516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:30.388397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:60091)
0811 14:29:30.388532 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:30.388575 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260811 14:29:30.495401 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:30.495150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:35319)
0811 14:29:30.495305 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:30.495354 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
I20260811 14:29:30.495420 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:30.495155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:39269)
0811 14:29:30.495336 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:30.495376 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":111,"threads_started":1}
I20260811 14:29:31.389294 7519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:31.389071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:58675)
0811 14:29:31.389200 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:31.389236 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260811 14:29:31.496220 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:31.495917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:47131)
0811 14:29:31.496069 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:31.496114 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":62,"threads_started":1}
I20260811 14:29:31.496256 7521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:31.495974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:41443)
0811 14:29:31.496174 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:31.496215 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":70,"threads_started":1}
I20260811 14:29:32.390018 7522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:32.389807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.194:37735)
0811 14:29:32.389937 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:32.389973 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":60,"threads_started":1}
I20260811 14:29:32.496892 7523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:32.496668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.195:44159)
0811 14:29:32.496812 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:32.496843 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260811 14:29:32.496907 7524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:32.496703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:34037 (local address 127.20.132.193:54943)
0811 14:29:32.496835 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:32.496864 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.254:34037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260811 14:29:33.037467 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 6973
I20260811 14:29:33.044790 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 7157
I20260811 14:29:33.051443 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 7308
2026-08-11T14:29:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58644 ms)
[----------] 30 tests from SecurityITest (237211 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:33 dist-test-slave-cbbz krb5kdc[7529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:33 dist-test-slave-cbbz krb5kdc[7529](info): set up 2 sockets
Aug 11 14:29:33 dist-test-slave-cbbz krb5kdc[7529](info): commencing operation
krb5kdc: starting...
W20260811 14:29:34.169322 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:29:34.294803 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41249
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:41249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:34.377035 7542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:34.377251 7542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:34.377274 7542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:34.378360 7542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:34.378393 7542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:34.378407 7542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:34.378420 7542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:34.378432 7542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:34.379824 7542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:41249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:34.380012 7542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:34.380213 7542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:29:34.385280 7542 server_base.cc:1034] running on GCE node
W20260811 14:29:34.385314 7550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.385301 7548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.385416 7547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:34.385859 7542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:34.386178 7542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:34.387354 7542 hybrid_clock.cc:648] HybridClock initialized: now 1786458574387340 us; error 31 us; skew 500 ppm
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:34.389962 7542 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:29:34.390347 7542 webserver.cc:460] Webserver started at http://127.20.132.254:41329/ using document root <none> and password file <none>
I20260811 14:29:34.390522 7542 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:34.390563 7542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:34.390666 7542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:34.391651 7542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "fc88902ed28c44039548c8a7e5bad3f2"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "359d6fba8075cd776aa703631aa43434"
server_key_iv: "fdc6c42c7d0c525b266c0347b299efe2"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.391953 7542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "fc88902ed28c44039548c8a7e5bad3f2"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "359d6fba8075cd776aa703631aa43434"
server_key_iv: "fdc6c42c7d0c525b266c0347b299efe2"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.393294 7542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:29:34.393980 7557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.394140 7542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:29:34.394227 7542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "fc88902ed28c44039548c8a7e5bad3f2"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "359d6fba8075cd776aa703631aa43434"
server_key_iv: "fdc6c42c7d0c525b266c0347b299efe2"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.394302 7542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:34.404798 7542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:34.407094 7542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:34.407229 7542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:34.413296 7542 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:41249
I20260811 14:29:34.413331 7615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:41249 every 8 connection(s)
I20260811 14:29:34.413693 7542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:34.414610 7616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:34.416926 7616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2: Bootstrap starting.
I20260811 14:29:34.417500 7616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:34.417742 7616 log.cc:824] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:34.418426 7616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2: No bootstrap required, opened a new log
I20260811 14:29:34.419981 7616 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc88902ed28c44039548c8a7e5bad3f2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41249 } }
I20260811 14:29:34.420223 7616 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:34.420287 7616 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc88902ed28c44039548c8a7e5bad3f2, State: Initialized, Role: FOLLOWER
I20260811 14:29:34.420324 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 7542
I20260811 14:29:34.420444 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:34.420433 7616 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc88902ed28c44039548c8a7e5bad3f2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41249 } }
I20260811 14:29:34.420509 7616 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:34.420549 7616 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:34.420598 7616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:34.420652 21011 external_mini_cluster.cc:1428] Setting key 1fb74590aa5fe75d408d2949308e1e1e
I20260811 14:29:34.421273 7616 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc88902ed28c44039548c8a7e5bad3f2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41249 } }
I20260811 14:29:34.421433 7616 leader_election.cc:302] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc88902ed28c44039548c8a7e5bad3f2; no voters:
I20260811 14:29:34.421629 7616 leader_election.cc:288] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:34.421670 7621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:34.421883 7621 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [term 1 LEADER]: Becoming Leader. State: Replica: fc88902ed28c44039548c8a7e5bad3f2, State: Running, Role: LEADER
I20260811 14:29:34.421892 7616 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:34.421998 7621 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc88902ed28c44039548c8a7e5bad3f2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41249 } }
I20260811 14:29:34.423491 7623 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc88902ed28c44039548c8a7e5bad3f2. Latest consensus state: current_term: 1 leader_uuid: "fc88902ed28c44039548c8a7e5bad3f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc88902ed28c44039548c8a7e5bad3f2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41249 } } }
I20260811 14:29:34.423621 7623 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:34.423816 7637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:34.423977 7622 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc88902ed28c44039548c8a7e5bad3f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc88902ed28c44039548c8a7e5bad3f2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41249 } } }
I20260811 14:29:34.424072 7622 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:34.424495 7637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:34.425964 7637 catalog_manager.cc:1347] Generated new cluster ID: e93ca37f8f03449383cdf200ac4d65bc
I20260811 14:29:34.426025 7637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:34.432742 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.421188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42506 (local address 127.20.132.254:41249)
0811 14:29:34.421390 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.421401 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.421435 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:29:34.421564 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.421570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.421637 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.421805 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:34.422771 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.424269 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.425339 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.425950 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.426141 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.428995 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:34.428999 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:34.429000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:34.429011 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:34.431001 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.431390 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.431393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.431393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.431518 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.431761 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.431762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.431763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.432165 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:34.432331 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.432403 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.432545 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
I20260811 14:29:34.447342 7637 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:34.447897 7637 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:34.453436 7637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2: Generated new TSK 0
I20260811 14:29:34.453653 7637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:29:34.487252 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41249
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:34.569597 7644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:34.569799 7644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:34.569823 7644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:34.570966 7644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:34.571008 7644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:34.571034 7644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:34.572623 7644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:34.572885 7644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:34.573123 7644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:34.578205 7654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.578143 7656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.578172 7652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:34.578377 7644 server_base.cc:1034] running on GCE node
I20260811 14:29:34.578576 7644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:34.578828 7644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:34.579998 7644 hybrid_clock.cc:648] HybridClock initialized: now 1786458574579983 us; error 29 us; skew 500 ppm
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:34.582675 7644 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:29:34.583118 7644 webserver.cc:460] Webserver started at http://127.20.132.193:40801/ using document root <none> and password file <none>
I20260811 14:29:34.583316 7644 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:34.583356 7644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:34.583446 7644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:34.584496 7644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "ae23d7de0c8642ab8b8be5d01bbb46df"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "9585e0021658c3e671f31ae818572fc0"
server_key_iv: "e68d090c9e2a4539f16f484fe7263731"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.584800 7644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "ae23d7de0c8642ab8b8be5d01bbb46df"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "9585e0021658c3e671f31ae818572fc0"
server_key_iv: "e68d090c9e2a4539f16f484fe7263731"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.586045 7644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:34.586723 7664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.586920 7644 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:34.587000 7644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "ae23d7de0c8642ab8b8be5d01bbb46df"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "9585e0021658c3e671f31ae818572fc0"
server_key_iv: "e68d090c9e2a4539f16f484fe7263731"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.587055 7644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:34.605415 7644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:34.607254 7644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:34.607366 7644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:34.607548 7644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:34.607882 7644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:34.607918 7644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.607940 7644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:34.607987 7644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.613804 7644 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:42541
I20260811 14:29:34.613895 7792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:42541 every 8 connection(s)
I20260811 14:29:34.614216 7644 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:34.622743 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 7644
I20260811 14:29:34.622875 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:29:34.623118 21011 external_mini_cluster.cc:1428] Setting key bfafca283c72e9cc5bd930c2327d05ea
I20260811 14:29:34.623663 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.614991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:43509 (local address 127.20.132.254:41249)
0811 14:29:34.615057 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.615059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.615275 (+ 216us) server_negotiation.cc:407] Connection header received
0811 14:29:34.615750 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.615751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.615763 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.615821 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:34.616824 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.617385 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.618350 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.618536 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.618588 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.620727 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:34.620729 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:34.620729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:34.620735 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:34.622100 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.622510 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.622511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.622512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.622616 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.622874 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.622876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.622876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.623046 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:34.623138 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.623478 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.623569 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:29:34.623908 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.614944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:41249 (local address 127.20.132.193:43509)
0811 14:29:34.615135 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:34.615176 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:34.615667 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:34.615875 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:34.615878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:34.616540 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:34.616729 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.616734 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.617472 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.617473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.618274 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.618276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.618611 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.618612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.618714 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.619248 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:34.619257 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:34.620644 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:34.622177 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:34.622183 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:34.622185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:34.622433 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:34.622692 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:34.622692 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:34.622693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:34.622795 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:34.623128 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:34.623136 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:34.623326 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 14:29:34.623446 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 14:29:34.623604 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260811 14:29:34.624570 7793 heartbeater.cc:347] Connected to a master server at 127.20.132.254:41249
I20260811 14:29:34.624679 7793 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:34.624874 7793 heartbeater.cc:511] Master 127.20.132.254:41249 requested a full tablet report, sending...
I20260811 14:29:34.625371 7577 ts_manager.cc:194] Registered new tserver with Master: ae23d7de0c8642ab8b8be5d01bbb46df (127.20.132.193:42541)
I20260811 14:29:34.626315 7577 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:43509
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:29:34.651142 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41249
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:34.735564 7798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:34.735809 7798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:34.735846 7798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:34.737046 7798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:34.737145 7798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:34.737205 7798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:34.738649 7798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:34.738909 7798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:34.739146 7798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:34.744079 7807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.744247 7805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:34.744342 7798 server_base.cc:1034] running on GCE node
W20260811 14:29:34.744118 7804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:34.744644 7798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:34.744920 7798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:34.746084 7798 hybrid_clock.cc:648] HybridClock initialized: now 1786458574746081 us; error 36 us; skew 500 ppm
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:34.748585 7798 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:29:34.749061 7798 webserver.cc:460] Webserver started at http://127.20.132.194:34685/ using document root <none> and password file <none>
I20260811 14:29:34.749305 7798 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:34.749370 7798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:34.749507 7798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:34.750526 7798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "08ac492438fe49c2a7993b7ff7d81135"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "fe9424fbfa305d576d4df56751e17b35"
server_key_iv: "21e85f8bf2f16bdd6cd483bca3e76852"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.750895 7798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "08ac492438fe49c2a7993b7ff7d81135"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "fe9424fbfa305d576d4df56751e17b35"
server_key_iv: "21e85f8bf2f16bdd6cd483bca3e76852"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.752251 7798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:34.752990 7815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.753178 7798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:34.753278 7798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "08ac492438fe49c2a7993b7ff7d81135"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "fe9424fbfa305d576d4df56751e17b35"
server_key_iv: "21e85f8bf2f16bdd6cd483bca3e76852"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.753360 7798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:34.776376 7798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:34.778232 7798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:34.778398 7798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:34.778654 7798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:34.778970 7798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:34.779023 7798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.779084 7798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:34.779114 7798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.785216 7798 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:44669
I20260811 14:29:34.785264 7947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:44669 every 8 connection(s)
I20260811 14:29:34.785578 7798 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:29:34.786490 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 7798
I20260811 14:29:34.786626 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:29:34.786847 21011 external_mini_cluster.cc:1428] Setting key d4be0ed1d01a777d4767df4d7bcb511f
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
I20260811 14:29:34.795650 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.786312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:45381 (local address 127.20.132.254:41249)
0811 14:29:34.786400 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.786402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.786568 (+ 166us) server_negotiation.cc:407] Connection header received
0811 14:29:34.787198 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.787199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.787228 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.787283 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:34.788365 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.789123 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.790194 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.790410 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.790497 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.792842 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:34.792843 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:34.792844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:34.792852 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:34.794274 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.794679 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.794680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.794681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.794743 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.794990 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.794991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.794991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.795108 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:34.795202 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.795472 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.795557 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:29:34.795845 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.786275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:41249 (local address 127.20.132.194:45381)
0811 14:29:34.786434 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:34.786477 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:34.787086 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:34.787342 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:34.787346 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:34.788010 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:34.788274 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.788280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.789208 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.789209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.790088 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.790091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.790508 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.790509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.790644 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.791286 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:34.791294 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:34.792747 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:34.794371 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:34.794378 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:34.794380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:34.794597 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:34.794808 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:34.794809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:34.794809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:34.794918 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:34.795192 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:34.795199 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:34.795338 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 14:29:34.795439 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 14:29:34.795596 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260811 14:29:34.796437 7948 heartbeater.cc:347] Connected to a master server at 127.20.132.254:41249
I20260811 14:29:34.796545 7948 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:34.796775 7948 heartbeater.cc:511] Master 127.20.132.254:41249 requested a full tablet report, sending...
I20260811 14:29:34.797194 7577 ts_manager.cc:194] Registered new tserver with Master: 08ac492438fe49c2a7993b7ff7d81135 (127.20.132.194:44669)
I20260811 14:29:34.797603 7577 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:45381
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:29:34.812587 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41249
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:36351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:34.894714 7953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:34.894924 7953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:34.894948 7953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:34.896054 7953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:34.896090 7953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:34.896116 7953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:34.897692 7953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:41249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:34.897887 7953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:34.898113 7953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:34.903169 7961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.903167 7963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:34.903127 7959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:34.903417 7953 server_base.cc:1034] running on GCE node
I20260811 14:29:34.903618 7953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:34.903903 7953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:34.905059 7953 hybrid_clock.cc:648] HybridClock initialized: now 1786458574905043 us; error 33 us; skew 500 ppm
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:34.907608 7953 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:29:34.908102 7953 webserver.cc:460] Webserver started at http://127.20.132.195:44807/ using document root <none> and password file <none>
I20260811 14:29:34.908387 7953 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:34.908437 7953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:34.908527 7953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:34.909505 7953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "7a6b2021fb3c48a08091248b8d795b95"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "df615a5b511d25dcaeab9d10ac06ded2"
server_key_iv: "d0c71d6074f30002b11ff5278355a993"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.909816 7953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "7a6b2021fb3c48a08091248b8d795b95"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "df615a5b511d25dcaeab9d10ac06ded2"
server_key_iv: "d0c71d6074f30002b11ff5278355a993"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.911072 7953 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:34.911737 7970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.911892 7953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:34.911978 7953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "7a6b2021fb3c48a08091248b8d795b95"
format_stamp: "Formatted at 2026-08-11 14:29:34 on dist-test-slave-cbbz"
server_key: "df615a5b511d25dcaeab9d10ac06ded2"
server_key_iv: "d0c71d6074f30002b11ff5278355a993"
server_key_version: "encryptionkey@0"
I20260811 14:29:34.912031 7953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:34.931715 7953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:34.933784 7953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:34.933897 7953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:34.934084 7953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:34.934418 7953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:34.934453 7953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.934500 7953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:34.934527 7953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:34.940366 7953 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:33049
I20260811 14:29:34.940438 8095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:33049 every 8 connection(s)
I20260811 14:29:34.940778 7953 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:29:34 dist-test-slave-cbbz krb5kdc[7529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458574, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:34.947499 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 7953
I20260811 14:29:34.947631 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:29:34.947856 21011 external_mini_cluster.cc:1428] Setting key f54b70717b370ff68481b73a862cf4f8
I20260811 14:29:34.950281 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.941531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47071 (local address 127.20.132.254:41249)
0811 14:29:34.941597 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.941599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.941826 (+ 227us) server_negotiation.cc:407] Connection header received
0811 14:29:34.942297 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.942298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.942309 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.942363 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:34.943261 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.943746 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.944754 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.944940 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.944995 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.947107 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:34.947108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:34.947109 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:34.947115 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:34.948867 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.949258 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.949260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.949260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.949348 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.949606 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.949607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.949607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.949733 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:34.949804 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.950081 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.950172 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 14:29:34.950510 8098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.941509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:41249 (local address 127.20.132.195:47071)
0811 14:29:34.941693 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:34.941729 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:34.942214 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:34.942438 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:34.942441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:34.942996 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:34.943186 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.943190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.943825 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.943825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.944681 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.944683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.945016 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.945016 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.945111 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.945539 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:34.945547 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:34.947017 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:34.948947 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:34.948953 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:34.948955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:34.949177 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:34.949417 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:34.949418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:34.949418 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:34.949526 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:34.949808 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:34.949815 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:34.949948 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 14:29:34.950056 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 14:29:34.950252 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260811 14:29:34.950989 8096 heartbeater.cc:347] Connected to a master server at 127.20.132.254:41249
I20260811 14:29:34.951068 8096 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:34.951262 8096 heartbeater.cc:511] Master 127.20.132.254:41249 requested a full tablet report, sending...
I20260811 14:29:34.951625 7577 ts_manager.cc:194] Registered new tserver with Master: 7a6b2021fb3c48a08091248b8d795b95 (127.20.132.195:33049)
I20260811 14:29:34.951968 7577 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:47071
I20260811 14:29:34.959669 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:29:34.967262 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.960972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42514 (local address 127.20.132.254:41249)
0811 14:29:34.961056 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.961058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.961161 (+ 103us) server_negotiation.cc:407] Connection header received
0811 14:29:34.961259 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.961260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.961271 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.961353 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:34.961931 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.962399 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.963118 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.963317 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.963395 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.964678 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:34.964680 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:34.964680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:34.964687 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:34.966077 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.966456 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.966457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.966458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.966514 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:34.966722 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:34.966722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:34.966723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:34.966872 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:34.966977 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.967087 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.967166 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 14:29:34.968916 7577 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42514:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:29:34.970454 7577 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:29:34.977079 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.972855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:42541 (local address 127.0.0.1:39862)
0811 14:29:34.973471 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:34.973480 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:34.973531 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:34.973828 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:34.973829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:34.973831 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:34.973887 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.973889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.974783 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.974784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.976011 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.976014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.976758 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.976759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.976837 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.976852 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 14:29:34.976944 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 14:29:34.976998 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":4,"thread_start_us":87,"threads_started":1}
I20260811 14:29:34.977092 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.973057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39862 (local address 127.20.132.193:42541)
0811 14:29:34.973272 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.973277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.973554 (+ 277us) server_negotiation.cc:407] Connection header received
0811 14:29:34.973612 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.973614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.973630 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.973710 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:34.973983 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.974665 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.976105 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.976669 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.976761 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.976819 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.976960 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.977004 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":105,"threads_started":1}
I20260811 14:29:34.977285 8108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.972856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:44669 (local address 127.0.0.1:49502)
0811 14:29:34.973048 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:34.973083 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:34.973138 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:34.973693 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:34.973694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:34.973695 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:34.973751 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.973753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.975093 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.975094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.976191 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.976193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.977055 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.977056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.977133 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.977136 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:34.977165 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 14:29:34.977212 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":7,"thread_start_us":69,"threads_started":1}
I20260811 14:29:34.977478 8111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.972858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:33049 (local address 127.0.0.1:36296)
0811 14:29:34.973289 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:34.973298 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:34.973352 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:34.973665 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:34.973668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:34.973670 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:34.973751 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.973754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.975222 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.975223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.976122 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:34.976125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.977054 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.977055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:34.977127 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.977131 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:34.977232 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 14:29:34.977265 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":5,"thread_start_us":103,"threads_started":1}
I20260811 14:29:34.977576 8113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.973099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36296 (local address 127.20.132.195:33049)
0811 14:29:34.973292 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.973296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.973343 (+ 47us) server_negotiation.cc:407] Connection header received
0811 14:29:34.973437 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.973439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.973455 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.973572 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:34.973846 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.975115 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.976231 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.976941 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.977338 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.977409 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.977437 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.977481 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
I20260811 14:29:34.977876 8114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:34.973276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49502 (local address 127.20.132.194:44669)
0811 14:29:34.973460 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:34.973465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:34.973475 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:29:34.973517 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:34.973519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:34.973535 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:34.973836 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:34.973920 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.974985 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.976280 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:34.976961 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:34.977634 (+ 673us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:34.977717 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:34.977743 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 14:29:34.977784 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
I20260811 14:29:34.977890 7719 tablet_service.cc:1467] Processing CreateTablet for tablet 9619f204976942f184d6ee7674f16197 (DEFAULT_TABLE table=test-table [id=939471ae82d64c9081532197e88ef53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:34.978240 7719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9619f204976942f184d6ee7674f16197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:34.978236 8026 tablet_service.cc:1467] Processing CreateTablet for tablet 9619f204976942f184d6ee7674f16197 (DEFAULT_TABLE table=test-table [id=939471ae82d64c9081532197e88ef53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:34.978420 7874 tablet_service.cc:1467] Processing CreateTablet for tablet 9619f204976942f184d6ee7674f16197 (DEFAULT_TABLE table=test-table [id=939471ae82d64c9081532197e88ef53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:34.978539 8026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9619f204976942f184d6ee7674f16197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:34.978668 7874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9619f204976942f184d6ee7674f16197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:34.981338 8115 tablet_bootstrap.cc:492] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Bootstrap starting.
I20260811 14:29:34.981684 8116 tablet_bootstrap.cc:492] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: Bootstrap starting.
I20260811 14:29:34.982048 8115 tablet_bootstrap.cc:654] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:34.982349 8116 tablet_bootstrap.cc:654] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:34.982728 8115 log.cc:824] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:34.983018 8116 log.cc:824] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:34.983397 8117 tablet_bootstrap.cc:492] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Bootstrap starting.
I20260811 14:29:34.983611 8115 tablet_bootstrap.cc:492] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: No bootstrap required, opened a new log
I20260811 14:29:34.983691 8115 ts_tablet_manager.cc:1397] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:34.983839 8116 tablet_bootstrap.cc:492] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: No bootstrap required, opened a new log
I20260811 14:29:34.983920 8116 ts_tablet_manager.cc:1397] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:34.984112 8117 tablet_bootstrap.cc:654] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:34.984717 8117 log.cc:824] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:34.985517 8117 tablet_bootstrap.cc:492] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: No bootstrap required, opened a new log
I20260811 14:29:34.985592 8117 ts_tablet_manager.cc:1397] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:34.985818 8116 raft_consensus.cc:348] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:34.985977 8116 raft_consensus.cc:374] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:34.985880 8115 raft_consensus.cc:348] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:34.986023 8116 raft_consensus.cc:729] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae23d7de0c8642ab8b8be5d01bbb46df, State: Initialized, Role: FOLLOWER
I20260811 14:29:34.986050 8115 raft_consensus.cc:374] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:34.986092 8115 raft_consensus.cc:729] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08ac492438fe49c2a7993b7ff7d81135, State: Initialized, Role: FOLLOWER
I20260811 14:29:34.986150 8116 consensus_queue.cc:260] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:34.986265 8115 consensus_queue.cc:260] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:34.986454 8116 ts_tablet_manager.cc:1428] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 14:29:34.986548 8115 ts_tablet_manager.cc:1428] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:29:34.986670 7793 heartbeater.cc:503] Master 127.20.132.254:41249 was elected leader, sending a full tablet report...
I20260811 14:29:34.986697 7948 heartbeater.cc:503] Master 127.20.132.254:41249 was elected leader, sending a full tablet report...
I20260811 14:29:34.988624 8117 raft_consensus.cc:348] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:34.988852 8117 raft_consensus.cc:374] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:34.988924 8117 raft_consensus.cc:729] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a6b2021fb3c48a08091248b8d795b95, State: Initialized, Role: FOLLOWER
I20260811 14:29:34.989039 8117 consensus_queue.cc:260] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:34.989326 8117 ts_tablet_manager.cc:1428] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 14:29:34.989351 8096 heartbeater.cc:503] Master 127.20.132.254:41249 was elected leader, sending a full tablet report...
I20260811 14:29:35.005183 8123 raft_consensus.cc:482] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:35.005313 8123 raft_consensus.cc:504] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:35.005674 8123 leader_election.cc:288] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08ac492438fe49c2a7993b7ff7d81135 (127.20.132.194:44669), 7a6b2021fb3c48a08091248b8d795b95 (127.20.132.195:33049)
I20260811 14:29:35.008584 8113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.005947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:49253 (local address 127.20.132.195:33049)
0811 14:29:35.006004 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.006007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.006017 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:29:35.006045 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.006046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.006056 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.006129 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.006314 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.006796 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.007705 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.008209 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.008302 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.008311 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.008471 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.008520 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 14:29:35.008595 8114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.006044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:60263 (local address 127.20.132.194:44669)
0811 14:29:35.006112 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.006114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.006123 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:29:35.006149 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.006150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.006159 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.006235 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.006394 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.006854 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.007777 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.008298 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.008355 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.008365 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.008504 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.008538 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:29:35.008582 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.005844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:33049 (local address 127.20.132.193:49253)
0811 14:29:35.005903 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.005916 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.005958 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.006157 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.006159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.006161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.006231 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.006233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.006880 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.006881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.007608 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.007610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.008300 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.008301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.008391 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.008395 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.008451 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.008498 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 14:29:35.008589 8126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.005844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:44669 (local address 127.20.132.193:60263)
0811 14:29:35.006031 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.006040 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.006088 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.006242 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.006243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.006245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.006323 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.006325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.006942 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.006943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.007683 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.007685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.008372 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.008373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.008437 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.008440 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.008485 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.008513 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":14,"thread_start_us":97,"threads_started":1}
I20260811 14:29:35.008981 7896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9619f204976942f184d6ee7674f16197" candidate_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08ac492438fe49c2a7993b7ff7d81135" is_pre_election: true
I20260811 14:29:35.008966 8047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9619f204976942f184d6ee7674f16197" candidate_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a6b2021fb3c48a08091248b8d795b95" is_pre_election: true
I20260811 14:29:35.009099 8047 raft_consensus.cc:2454] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae23d7de0c8642ab8b8be5d01bbb46df in term 0.
I20260811 14:29:35.009135 7896 raft_consensus.cc:2454] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae23d7de0c8642ab8b8be5d01bbb46df in term 0.
I20260811 14:29:35.009341 7668 leader_election.cc:302] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08ac492438fe49c2a7993b7ff7d81135, ae23d7de0c8642ab8b8be5d01bbb46df; no voters:
I20260811 14:29:35.009465 8123 raft_consensus.cc:2781] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:29:35.009555 8123 raft_consensus.cc:482] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:35.009589 8123 raft_consensus.cc:3037] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.010322 8123 raft_consensus.cc:504] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:35.010473 8123 leader_election.cc:288] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [CANDIDATE]: Term 1 election: Requested vote from peers 08ac492438fe49c2a7993b7ff7d81135 (127.20.132.194:44669), 7a6b2021fb3c48a08091248b8d795b95 (127.20.132.195:33049)
I20260811 14:29:35.010614 8047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9619f204976942f184d6ee7674f16197" candidate_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a6b2021fb3c48a08091248b8d795b95"
I20260811 14:29:35.010645 7896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9619f204976942f184d6ee7674f16197" candidate_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08ac492438fe49c2a7993b7ff7d81135"
I20260811 14:29:35.010715 8047 raft_consensus.cc:3037] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.010715 7896 raft_consensus.cc:3037] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.011556 8047 raft_consensus.cc:2454] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae23d7de0c8642ab8b8be5d01bbb46df in term 1.
I20260811 14:29:35.011667 7896 raft_consensus.cc:2454] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae23d7de0c8642ab8b8be5d01bbb46df in term 1.
I20260811 14:29:35.011755 7665 leader_election.cc:302] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a6b2021fb3c48a08091248b8d795b95, ae23d7de0c8642ab8b8be5d01bbb46df; no voters:
I20260811 14:29:35.011869 8123 raft_consensus.cc:2781] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:35.012069 8123 raft_consensus.cc:686] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [term 1 LEADER]: Becoming Leader. State: Replica: ae23d7de0c8642ab8b8be5d01bbb46df, State: Running, Role: LEADER
I20260811 14:29:35.012245 8123 consensus_queue.cc:237] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } }
I20260811 14:29:35.013351 7576 catalog_manager.cc:5495] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df reported cstate change: term changed from 0 to 1, leader changed from <none> to ae23d7de0c8642ab8b8be5d01bbb46df (127.20.132.193). New cstate: current_term: 1 leader_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae23d7de0c8642ab8b8be5d01bbb46df" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 42541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260811 14:29:35.022048 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.019892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39864 (local address 127.20.132.193:42541)
0811 14:29:35.019951 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.019957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.019965 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:29:35.019991 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.019992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.020007 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.020065 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:29:35.020228 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.020662 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.021363 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.021536 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.021584 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.021713 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:29:35.021837 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:29:35.021900 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.021921 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.021938 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:29:35.023818 7896 raft_consensus.cc:1261] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 1 FOLLOWER]: Refusing update from remote peer ae23d7de0c8642ab8b8be5d01bbb46df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:35.023838 8047 raft_consensus.cc:1261] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 1 FOLLOWER]: Refusing update from remote peer ae23d7de0c8642ab8b8be5d01bbb46df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:35.024217 8123 consensus_queue.cc:1035] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a6b2021fb3c48a08091248b8d795b95" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:35.024365 8127 consensus_queue.cc:1035] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df [LEADER]: Connected to new peer: Peer: permanent_uuid: "08ac492438fe49c2a7993b7ff7d81135" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 44669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:35.026376 8132 mvcc.cc:205] Tried to move back new op lower bound from 7317334323294990336 to 7317334323250806784. Current Snapshot: MvccSnapshot[applied={T|T < 7317334323294990336}]
I20260811 14:29:35.027657 8133 mvcc.cc:205] Tried to move back new op lower bound from 7317334323294990336 to 7317334323250806784. Current Snapshot: MvccSnapshot[applied={T|T < 7317334323294990336 or (T in {7317334323294990336})}]
I20260811 14:29:35.027797 8134 mvcc.cc:205] Tried to move back new op lower bound from 7317334323294990336 to 7317334323250806784. Current Snapshot: MvccSnapshot[applied={T|T < 7317334323294990336}]
I20260811 14:29:35.028832 7577 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:35.028923 7577 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:35.029626 7577 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc88902ed28c44039548c8a7e5bad3f2: Sending DeleteTablet for 3 replicas of tablet 9619f204976942f184d6ee7674f16197
I20260811 14:29:35.029948 7719 tablet_service.cc:1514] Processing DeleteTablet for tablet 9619f204976942f184d6ee7674f16197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:35 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:39862
I20260811 14:29:35.029956 7874 tablet_service.cc:1514] Processing DeleteTablet for tablet 9619f204976942f184d6ee7674f16197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:35 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:49502
I20260811 14:29:35.029990 8026 tablet_service.cc:1514] Processing DeleteTablet for tablet 9619f204976942f184d6ee7674f16197 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:35 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:36296
I20260811 14:29:35.030195 8143 tablet_replica.cc:330] T 9619f204976942f184d6ee7674f16197 P ae23d7de0c8642ab8b8be5d01bbb46df: stopping tablet replica
I20260811 14:29:35.030370 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 7644
I20260811 14:29:35.033190 8145 tablet_replica.cc:330] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: stopping tablet replica
I20260811 14:29:35.033300 8145 raft_consensus.cc:2229] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:35.033406 8145 raft_consensus.cc:2258] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:35.033553 8144 tablet_replica.cc:330] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: stopping tablet replica
I20260811 14:29:35.033653 8144 raft_consensus.cc:2229] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:35.033756 8144 raft_consensus.cc:2258] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:35.033893 8145 ts_tablet_manager.cc:1905] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:35.034173 8144 ts_tablet_manager.cc:1905] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:35.035705 8145 ts_tablet_manager.cc:1918] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:35.035796 8145 log.cc:1196] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/9619f204976942f184d6ee7674f16197
I20260811 14:29:35.036116 8145 ts_tablet_manager.cc:1939] T 9619f204976942f184d6ee7674f16197 P 7a6b2021fb3c48a08091248b8d795b95: Deleting consensus metadata
I20260811 14:29:35.036223 8144 ts_tablet_manager.cc:1918] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:35.036302 8144 log.cc:1196] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/9619f204976942f184d6ee7674f16197
I20260811 14:29:35.036582 8144 ts_tablet_manager.cc:1939] T 9619f204976942f184d6ee7674f16197 P 08ac492438fe49c2a7993b7ff7d81135: Deleting consensus metadata
I20260811 14:29:35.036583 7558 catalog_manager.cc:4841] TS 7a6b2021fb3c48a08091248b8d795b95 (127.20.132.195:33049): tablet 9619f204976942f184d6ee7674f16197 (table test-table [id=939471ae82d64c9081532197e88ef53d]) successfully deleted
I20260811 14:29:35.037015 7563 catalog_manager.cc:4841] TS 08ac492438fe49c2a7993b7ff7d81135 (127.20.132.194:44669): tablet 9619f204976942f184d6ee7674f16197 (table test-table [id=939471ae82d64c9081532197e88ef53d]) successfully deleted
W20260811 14:29:35.039651 7562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:42541 (error 108)
I20260811 14:29:35.039848 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 7798
I20260811 14:29:35.040799 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.040033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:42541 (local address 127.0.0.1:39868)
0811 14:29:35.040709 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.040757 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":653}
W20260811 14:29:35.041836 7562 catalog_manager.cc:4584] TS ae23d7de0c8642ab8b8be5d01bbb46df (127.20.132.193:42541): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9619f204976942f184d6ee7674f16197: Network error: Client connection negotiation failed: client connection to 127.20.132.193:42541: connect: Connection refused (error 111)
I20260811 14:29:35.048219 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 7953
I20260811 14:29:35.054649 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 7542
2026-08-11T14:29:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2002 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T14:29:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:35Z Disabled control of system clock
I20260811 14:29:35.084276 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45541
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:45541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:35.167706 8152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:35.167939 8152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:35.167963 8152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:35.169241 8152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:35.169291 8152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:35.169305 8152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:35.169320 8152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:35.169334 8152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:35.170784 8152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:45541
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:45541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:35.171051 8152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:35.171368 8152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:35.176425 8160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:35.176440 8162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:35.176607 8152 server_base.cc:1034] running on GCE node
W20260811 14:29:35.176811 8165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:35.177160 8152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:35.177522 8152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:35.178686 8152 hybrid_clock.cc:648] HybridClock initialized: now 1786458575178689 us; error 48 us; skew 500 ppm
I20260811 14:29:35.179999 8152 webserver.cc:460] Webserver started at http://127.20.132.254:38883/ using document root <none> and password file <none>
I20260811 14:29:35.180323 8152 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:35.180398 8152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:35.180540 8152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:35.181710 8152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "e5eff8810009484eab01c2e23144dff2"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "2db0678d44593ba37038c11e1f1607b2"
server_key_iv: "13820e3867a660a80ad30373905d2c13"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.182103 8152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "e5eff8810009484eab01c2e23144dff2"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "2db0678d44593ba37038c11e1f1607b2"
server_key_iv: "13820e3867a660a80ad30373905d2c13"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.183439 8152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:35.184247 8171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.184423 8152 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:35.184526 8152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "e5eff8810009484eab01c2e23144dff2"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "2db0678d44593ba37038c11e1f1607b2"
server_key_iv: "13820e3867a660a80ad30373905d2c13"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.184609 8152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:35.209879 8152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:35.210222 8152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:35.210387 8152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:35.214601 8152 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:45541
I20260811 14:29:35.214648 8225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:45541 every 8 connection(s)
I20260811 14:29:35.215014 8152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:35.216032 8226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:35.218354 8226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2: Bootstrap starting.
I20260811 14:29:35.218966 8226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:35.219043 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 8152
I20260811 14:29:35.219165 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:35.219357 8226 log.cc:824] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:35.219393 21011 external_mini_cluster.cc:1428] Setting key 079a4da76e7311895a12eb34353c2d98
I20260811 14:29:35.220220 8226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2: No bootstrap required, opened a new log
I20260811 14:29:35.222548 8226 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eff8810009484eab01c2e23144dff2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45541 } }
I20260811 14:29:35.222783 8226 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:35.222841 8226 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5eff8810009484eab01c2e23144dff2, State: Initialized, Role: FOLLOWER
I20260811 14:29:35.222995 8226 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eff8810009484eab01c2e23144dff2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45541 } }
I20260811 14:29:35.223088 8226 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:35.223117 8226 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:35.223160 8226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.223816 8226 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eff8810009484eab01c2e23144dff2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45541 } }
I20260811 14:29:35.223904 8226 leader_election.cc:302] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5eff8810009484eab01c2e23144dff2; no voters:
I20260811 14:29:35.224085 8226 leader_election.cc:288] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:35.224129 8231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:35.224308 8231 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [term 1 LEADER]: Becoming Leader. State: Replica: e5eff8810009484eab01c2e23144dff2, State: Running, Role: LEADER
I20260811 14:29:35.224406 8231 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eff8810009484eab01c2e23144dff2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45541 } }
I20260811 14:29:35.224404 8226 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:35.225651 8232 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5eff8810009484eab01c2e23144dff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eff8810009484eab01c2e23144dff2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45541 } } }
I20260811 14:29:35.225744 8232 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:35.225901 8233 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5eff8810009484eab01c2e23144dff2. Latest consensus state: current_term: 1 leader_uuid: "e5eff8810009484eab01c2e23144dff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5eff8810009484eab01c2e23144dff2" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 45541 } } }
I20260811 14:29:35.225958 8246 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:35.225993 8233 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:35.226468 8246 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:35.226974 8230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.219911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45768 (local address 127.20.132.254:45541)
0811 14:29:35.220127 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.220160 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.220193 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:29:35.220729 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.220738 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.220816 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.220962 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:35.221135 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.223372 (+ 2237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.224312 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.225000 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.225520 (+ 520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.226016 (+ 496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:35.226020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:35.226020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:35.226220 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:35.226266 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:35.226309 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:35.226382 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.226468 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.226646 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260811 14:29:35.228107 8246 catalog_manager.cc:1347] Generated new cluster ID: 969c5f2bb9f6465394bd992d5c0956f7
I20260811 14:29:35.228188 8246 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:35.246392 8246 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:35.246945 8246 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:35.256047 8246 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2: Generated new TSK 0
I20260811 14:29:35.256280 8246 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:35.260646 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45541
--builtin_ntp_servers=127.20.132.212:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:35.352193 8252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:35.352396 8252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:35.352416 8252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:35.353582 8252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:35.353627 8252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:35.353653 8252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:35.355007 8252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:35.355249 8252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:35.355571 8252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:35.360683 8257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:35.360800 8260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:35.360859 8258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:35.361128 8252 server_base.cc:1034] running on GCE node
I20260811 14:29:35.361359 8252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:35.361601 8252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:35.362766 8252 hybrid_clock.cc:648] HybridClock initialized: now 1786458575362740 us; error 42 us; skew 500 ppm
I20260811 14:29:35.364095 8252 webserver.cc:460] Webserver started at http://127.20.132.193:45099/ using document root <none> and password file <none>
I20260811 14:29:35.364387 8252 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:35.364459 8252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:35.364616 8252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:35.365690 8252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "9aae6ea982c04ce2936e7380afa75dcc"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "04b051340693f40b9fcac69400f5e8ba"
server_key_iv: "f907a7e17e6ff3c8306137e57046863f"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.366073 8252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "9aae6ea982c04ce2936e7380afa75dcc"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "04b051340693f40b9fcac69400f5e8ba"
server_key_iv: "f907a7e17e6ff3c8306137e57046863f"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.367456 8252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:35.368238 8267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.368431 8252 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:35.368525 8252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "9aae6ea982c04ce2936e7380afa75dcc"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "04b051340693f40b9fcac69400f5e8ba"
server_key_iv: "f907a7e17e6ff3c8306137e57046863f"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.368614 8252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:35.379434 8252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:35.379729 8252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:35.379875 8252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:35.380110 8252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:35.380476 8252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:35.380512 8252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.380533 8252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:35.380581 8252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.386575 8252 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:40511
I20260811 14:29:35.386620 8391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:40511 every 8 connection(s)
I20260811 14:29:35.386963 8252 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:29:35.392385 8230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.387740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:35821 (local address 127.20.132.254:45541)
0811 14:29:35.387801 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.387803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.388039 (+ 236us) server_negotiation.cc:407] Connection header received
0811 14:29:35.388694 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.388696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.388709 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.388758 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:35.389450 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.389954 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.390955 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.391174 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.391268 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.392003 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:35.392004 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:35.392005 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:35.392009 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:35.392024 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:35.392028 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:35.392071 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.392279 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.392306 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:29:35.392606 8394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.387741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45541 (local address 127.20.132.193:35821)
0811 14:29:35.387923 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.387956 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.388581 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.388822 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.388826 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.388835 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:35.389346 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.389351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.390050 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.390051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.390862 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.390864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.391280 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.391281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.391413 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.391866 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:35.391866 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:35.391893 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:35.391914 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:35.392083 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:35.392087 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:35.392090 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.392277 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.392378 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260811 14:29:35.393136 8392 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45541
I20260811 14:29:35.393240 8392 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:35.393396 8392 heartbeater.cc:511] Master 127.20.132.254:45541 requested a full tablet report, sending...
I20260811 14:29:35.393848 8188 ts_manager.cc:194] Registered new tserver with Master: 9aae6ea982c04ce2936e7380afa75dcc (127.20.132.193:40511)
I20260811 14:29:35.394415 8188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.193:35821
I20260811 14:29:35.396808 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 8252
I20260811 14:29:35.396924 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:29:35.397145 21011 external_mini_cluster.cc:1428] Setting key 2e9a7b1e2cb9de21b5e0ecbe2adfc290
I20260811 14:29:35.398039 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45541
--builtin_ntp_servers=127.20.132.212:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:35.480644 8395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:35.480849 8395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:35.480872 8395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:35.481972 8395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:35.482007 8395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:35.482031 8395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:35.483295 8395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:35.483481 8395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:35.483747 8395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:35.488906 8403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:35.488945 8401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:35.488950 8400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:35.489228 8395 server_base.cc:1034] running on GCE node
I20260811 14:29:35.489435 8395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:35.489667 8395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:35.490863 8395 hybrid_clock.cc:648] HybridClock initialized: now 1786458575490852 us; error 26 us; skew 500 ppm
I20260811 14:29:35.492259 8395 webserver.cc:460] Webserver started at http://127.20.132.194:33077/ using document root <none> and password file <none>
I20260811 14:29:35.492545 8395 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:35.492595 8395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:35.492792 8395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:35.493904 8395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "2e30cdabf08143e8925409e442fe9ef2"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "7c01870d81feb870430f84df34a19b1b"
server_key_iv: "6ef8517e728371644991b442ec7e8fc2"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.494287 8395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "2e30cdabf08143e8925409e442fe9ef2"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "7c01870d81feb870430f84df34a19b1b"
server_key_iv: "6ef8517e728371644991b442ec7e8fc2"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.495635 8395 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:29:35.496445 8412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.496626 8395 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:35.496721 8395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "2e30cdabf08143e8925409e442fe9ef2"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "7c01870d81feb870430f84df34a19b1b"
server_key_iv: "6ef8517e728371644991b442ec7e8fc2"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.496801 8395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:35.513370 8395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:35.513691 8395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:35.513850 8395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:35.514086 8395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:35.514425 8395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:35.514459 8395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.514504 8395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:35.514533 8395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.520350 8395 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:36869
I20260811 14:29:35.520447 8538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:36869 every 8 connection(s)
I20260811 14:29:35.520771 8395 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:29:35.523068 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 8395
I20260811 14:29:35.523197 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:29:35.523422 21011 external_mini_cluster.cc:1428] Setting key 562bad27abd4925a6925aef51e8bb131
I20260811 14:29:35.524408 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45541
--builtin_ntp_servers=127.20.132.212:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 14:29:35.526690 8230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.521495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:53153 (local address 127.20.132.254:45541)
0811 14:29:35.521544 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.521547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.521816 (+ 269us) server_negotiation.cc:407] Connection header received
0811 14:29:35.522376 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.522378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.522392 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.522446 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:35.523309 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.523956 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.525236 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.525502 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.525575 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.526414 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:35.526415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:35.526415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:35.526421 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:35.526435 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:35.526439 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:35.526489 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.526584 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.526612 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:29:35.526918 8541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.521451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45541 (local address 127.20.132.194:53153)
0811 14:29:35.521656 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.521711 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.522266 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.522514 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.522518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.522528 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:35.523180 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.523188 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.524065 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.524066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.525124 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.525127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.525598 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.525599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.525737 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.526270 (+ 533us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:35.526271 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:35.526299 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:35.526322 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:35.526489 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:35.526494 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:35.526497 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.526586 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.526687 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
I20260811 14:29:35.527498 8539 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45541
I20260811 14:29:35.527590 8539 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:35.527791 8539 heartbeater.cc:511] Master 127.20.132.254:45541 requested a full tablet report, sending...
I20260811 14:29:35.528223 8188 ts_manager.cc:194] Registered new tserver with Master: 2e30cdabf08143e8925409e442fe9ef2 (127.20.132.194:36869)
I20260811 14:29:35.528600 8188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.194:53153
W20260811 14:29:35.607535 8542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:35.607864 8542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:35.607906 8542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:35.609380 8542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:35.609426 8542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:35.609452 8542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:35.610708 8542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:45541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:35.610893 8542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:35.611125 8542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:35.615981 8548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:35.615990 8547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:35.616225 8542 server_base.cc:1034] running on GCE node
W20260811 14:29:35.615994 8551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:35.616499 8542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:35.616691 8542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:35.617827 8542 hybrid_clock.cc:648] HybridClock initialized: now 1786458575617815 us; error 28 us; skew 500 ppm
I20260811 14:29:35.619012 8542 webserver.cc:460] Webserver started at http://127.20.132.195:36111/ using document root <none> and password file <none>
I20260811 14:29:35.619270 8542 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:35.619318 8542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:35.619474 8542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:35.620560 8542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "e27e430055184e0d8fe619421e5efb10"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "42e4d89d80e3f1cb0235bdca3cd5f976"
server_key_iv: "00fb3a7fc7d0707332cbaa44429d4d2e"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.620906 8542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "e27e430055184e0d8fe619421e5efb10"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "42e4d89d80e3f1cb0235bdca3cd5f976"
server_key_iv: "00fb3a7fc7d0707332cbaa44429d4d2e"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.622221 8542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:29:35.622931 8557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.623164 8542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:35.623258 8542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "e27e430055184e0d8fe619421e5efb10"
format_stamp: "Formatted at 2026-08-11 14:29:35 on dist-test-slave-cbbz"
server_key: "42e4d89d80e3f1cb0235bdca3cd5f976"
server_key_iv: "00fb3a7fc7d0707332cbaa44429d4d2e"
server_key_version: "encryptionkey@0"
I20260811 14:29:35.623311 8542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:35.633303 8542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:35.633704 8542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:35.633811 8542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:35.633992 8542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:35.634313 8542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:35.634346 8542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.634398 8542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:35.634433 8542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:35.640291 8542 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:40419
I20260811 14:29:35.640347 8689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:40419 every 8 connection(s)
I20260811 14:29:35.640669 8542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:29:35.650499 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 8542
I20260811 14:29:35.650593 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:29:35.650833 21011 external_mini_cluster.cc:1428] Setting key 68cef2b7aac9dbe1281f97e016ffd35c
I20260811 14:29:35.651455 8230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.641371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:60945 (local address 127.20.132.254:45541)
0811 14:29:35.641448 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.641450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.641681 (+ 231us) server_negotiation.cc:407] Connection header received
0811 14:29:35.642266 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.642267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.642281 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.642339 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:35.643006 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.643501 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.644504 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.644722 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.644797 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.651126 (+ 6329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:35.651127 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:35.651128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:35.651133 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:35.651153 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:35.651157 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:35.651225 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.651342 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.651372 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:29:35.651705 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.641340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:45541 (local address 127.20.132.195:60945)
0811 14:29:35.641558 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.641591 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.642148 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.642410 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.642413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.642421 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:35.642898 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.642902 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.643602 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.643603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.644405 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.644407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.644805 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.644806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.644933 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.650903 (+ 5970us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:35.650904 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:35.650960 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:35.650999 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:35.651241 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:35.651249 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:35.651252 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.651326 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.651464 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260811 14:29:35.652257 8691 heartbeater.cc:347] Connected to a master server at 127.20.132.254:45541
I20260811 14:29:35.652361 8691 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:35.652540 8691 heartbeater.cc:511] Master 127.20.132.254:45541 requested a full tablet report, sending...
I20260811 14:29:35.652892 8188 ts_manager.cc:194] Registered new tserver with Master: e27e430055184e0d8fe619421e5efb10 (127.20.132.195:40419)
I20260811 14:29:35.653240 8188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.195:60945
I20260811 14:29:35.662865 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:29:35.667228 8230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.664300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45774 (local address 127.20.132.254:45541)
0811 14:29:35.664371 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.664373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.664485 (+ 112us) server_negotiation.cc:407] Connection header received
0811 14:29:35.664561 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.664562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.664573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.664620 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:35.664802 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.665283 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.666038 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.666255 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.666332 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.666965 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:35.666966 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:35.666966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:35.666971 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:35.666984 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:35.666988 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:35.667054 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.667118 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.667138 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:29:35.668747 8188 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:29:35.670256 8188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:29:35.676359 8700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.672292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:40511 (local address 127.0.0.1:40980)
0811 14:29:35.672454 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.672496 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.672568 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.672776 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.672779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.672781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.672842 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.672843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.674128 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.674129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.675306 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.675308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.676033 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.676034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.676109 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.676123 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.676233 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.676283 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260811 14:29:35.676367 8702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.672377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.20.132.193:40511)
0811 14:29:35.672596 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.672601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.672611 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:29:35.672652 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.672654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.672667 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.672771 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.672901 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.674030 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.675405 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.675956 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.676035 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.676122 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.676247 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.676285 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":103,"threads_started":1}
I20260811 14:29:35.677023 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.672293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:40419 (local address 127.0.0.1:36310)
0811 14:29:35.672454 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.672497 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.672564 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.673275 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.673275 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.673277 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.673360 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.673363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.674681 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.674682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.675804 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.675807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.676779 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.676780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.676853 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.676857 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.676914 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.676954 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":50,"threads_started":1}
I20260811 14:29:35.677037 8705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.672607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36310 (local address 127.20.132.195:40419)
0811 14:29:35.672752 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.672757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.672768 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:29:35.672808 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.672810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.672825 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.672907 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.673448 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.674590 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.675903 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.676681 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.676758 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.676840 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.676926 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.676962 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
I20260811 14:29:35.677099 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 01b28c0de93b41f08a9364af8fed169b (DEFAULT_TABLE table=test-table [id=6287feaa7fdc4fed872fbde1c654440b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:35.677501 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b28c0de93b41f08a9364af8fed169b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:35.677847 8614 tablet_service.cc:1467] Processing CreateTablet for tablet 01b28c0de93b41f08a9364af8fed169b (DEFAULT_TABLE table=test-table [id=6287feaa7fdc4fed872fbde1c654440b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:35.678186 8614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b28c0de93b41f08a9364af8fed169b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:35.681142 8707 tablet_bootstrap.cc:492] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc: Bootstrap starting.
I20260811 14:29:35.681521 8710 tablet_bootstrap.cc:492] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Bootstrap starting.
I20260811 14:29:35.681885 8707 tablet_bootstrap.cc:654] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:35.682219 8710 tablet_bootstrap.cc:654] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:35.682219 8707 log.cc:824] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:35.682554 8710 log.cc:824] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:35.683028 8707 tablet_bootstrap.cc:492] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc: No bootstrap required, opened a new log
I20260811 14:29:35.683036 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.672478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:36869 (local address 127.0.0.1:48028)
0811 14:29:35.673107 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.673116 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.673197 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.674575 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.674576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.674578 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.674615 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.674617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.675924 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.675924 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.681855 (+ 5931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.681858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.682796 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.682798 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.682863 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.682869 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.682903 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.682952 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":62,"threads_started":1}
I20260811 14:29:35.683274 8707 ts_tablet_manager.cc:1397] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:35.683344 8710 tablet_bootstrap.cc:492] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: No bootstrap required, opened a new log
I20260811 14:29:35.683414 8710 ts_tablet_manager.cc:1397] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:29:35.683408 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.672856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48028 (local address 127.20.132.194:36869)
0811 14:29:35.673034 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.673038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.673252 (+ 214us) server_negotiation.cc:407] Connection header received
0811 14:29:35.674445 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.674449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.674470 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.674575 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.674682 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.675840 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.681949 (+ 6109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.682657 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.683171 (+ 514us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.683268 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.683290 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.683324 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260811 14:29:35.683971 8464 tablet_service.cc:1467] Processing CreateTablet for tablet 01b28c0de93b41f08a9364af8fed169b (DEFAULT_TABLE table=test-table [id=6287feaa7fdc4fed872fbde1c654440b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:35.684346 8464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b28c0de93b41f08a9364af8fed169b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:35.686292 8707 raft_consensus.cc:348] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.686390 8710 raft_consensus.cc:348] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.686482 8707 raft_consensus.cc:374] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:35.686518 8710 raft_consensus.cc:374] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:35.686523 8707 raft_consensus.cc:729] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aae6ea982c04ce2936e7380afa75dcc, State: Initialized, Role: FOLLOWER
I20260811 14:29:35.686553 8710 raft_consensus.cc:729] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27e430055184e0d8fe619421e5efb10, State: Initialized, Role: FOLLOWER
I20260811 14:29:35.686654 8710 consensus_queue.cc:260] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.686654 8707 consensus_queue.cc:260] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.686914 8707 ts_tablet_manager.cc:1428] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 14:29:35.686914 8710 ts_tablet_manager.cc:1428] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 14:29:35.687069 8691 heartbeater.cc:503] Master 127.20.132.254:45541 was elected leader, sending a full tablet report...
I20260811 14:29:35.687111 8392 heartbeater.cc:503] Master 127.20.132.254:45541 was elected leader, sending a full tablet report...
I20260811 14:29:35.687738 8713 tablet_bootstrap.cc:492] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Bootstrap starting.
I20260811 14:29:35.688429 8713 tablet_bootstrap.cc:654] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:35.688730 8713 log.cc:824] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:35.689497 8713 tablet_bootstrap.cc:492] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: No bootstrap required, opened a new log
I20260811 14:29:35.689599 8713 ts_tablet_manager.cc:1397] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:29:35.691368 8713 raft_consensus.cc:348] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.691519 8713 raft_consensus.cc:374] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:35.691569 8713 raft_consensus.cc:729] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e30cdabf08143e8925409e442fe9ef2, State: Initialized, Role: FOLLOWER
I20260811 14:29:35.691699 8713 consensus_queue.cc:260] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.692006 8713 ts_tablet_manager.cc:1428] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 14:29:35.692028 8539 heartbeater.cc:503] Master 127.20.132.254:45541 was elected leader, sending a full tablet report...
I20260811 14:29:35.718696 8714 raft_consensus.cc:482] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:35.718863 8714 raft_consensus.cc:504] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.719244 8714 leader_election.cc:288] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aae6ea982c04ce2936e7380afa75dcc (127.20.132.193:40511), 2e30cdabf08143e8925409e442fe9ef2 (127.20.132.194:36869)
I20260811 14:29:35.722783 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.719459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:40511 (local address 127.20.132.195:49513)
0811 14:29:35.719518 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.719531 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.719578 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.719772 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.719773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.719775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.719877 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.719879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.720610 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.720611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.721801 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.721803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.722538 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.722539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.722601 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.722604 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.722662 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.722697 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 14:29:35.722826 8702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.719552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:49513 (local address 127.20.132.193:40511)
0811 14:29:35.719610 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.719612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.719623 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:29:35.719660 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.719661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.719673 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.719755 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.719949 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.720528 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.721887 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.722430 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.722508 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.722517 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.722686 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.722743 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 14:29:35.723133 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b28c0de93b41f08a9364af8fed169b" candidate_uuid: "e27e430055184e0d8fe619421e5efb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aae6ea982c04ce2936e7380afa75dcc" is_pre_election: true
I20260811 14:29:35.723294 8344 raft_consensus.cc:2454] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27e430055184e0d8fe619421e5efb10 in term 0.
I20260811 14:29:35.723562 8562 leader_election.cc:302] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9aae6ea982c04ce2936e7380afa75dcc, e27e430055184e0d8fe619421e5efb10; no voters:
I20260811 14:29:35.723734 8714 raft_consensus.cc:2781] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:29:35.723803 8714 raft_consensus.cc:482] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:35.723835 8714 raft_consensus.cc:3037] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.723829 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.719704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:52573 (local address 127.20.132.194:36869)
0811 14:29:35.719751 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.719753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.719843 (+ 90us) server_negotiation.cc:407] Connection header received
0811 14:29:35.719878 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.719878 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.719889 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.719944 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:35.720792 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.721507 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.722816 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.723458 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.723545 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.723555 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.723704 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.723755 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:29:35.723865 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.719598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:36869 (local address 127.20.132.195:52573)
0811 14:29:35.719760 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.719771 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:35.719835 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:35.720614 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:35.720615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:35.720616 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:35.720687 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.720688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.721602 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.721603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.722714 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:35.722717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.723547 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.723548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:35.723614 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.723618 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:35.723682 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:29:35.723720 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260811 14:29:35.724238 8487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b28c0de93b41f08a9364af8fed169b" candidate_uuid: "e27e430055184e0d8fe619421e5efb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30cdabf08143e8925409e442fe9ef2" is_pre_election: true
I20260811 14:29:35.724401 8487 raft_consensus.cc:2454] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27e430055184e0d8fe619421e5efb10 in term 0.
I20260811 14:29:35.724862 8714 raft_consensus.cc:504] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.724978 8714 leader_election.cc:288] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [CANDIDATE]: Term 1 election: Requested vote from peers 9aae6ea982c04ce2936e7380afa75dcc (127.20.132.193:40511), 2e30cdabf08143e8925409e442fe9ef2 (127.20.132.194:36869)
I20260811 14:29:35.725136 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b28c0de93b41f08a9364af8fed169b" candidate_uuid: "e27e430055184e0d8fe619421e5efb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aae6ea982c04ce2936e7380afa75dcc"
I20260811 14:29:35.725162 8487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b28c0de93b41f08a9364af8fed169b" candidate_uuid: "e27e430055184e0d8fe619421e5efb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e30cdabf08143e8925409e442fe9ef2"
I20260811 14:29:35.725229 8487 raft_consensus.cc:3037] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.725229 8344 raft_consensus.cc:3037] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:35.726243 8487 raft_consensus.cc:2454] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27e430055184e0d8fe619421e5efb10 in term 1.
I20260811 14:29:35.726243 8344 raft_consensus.cc:2454] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27e430055184e0d8fe619421e5efb10 in term 1.
I20260811 14:29:35.726409 8562 leader_election.cc:302] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e30cdabf08143e8925409e442fe9ef2, e27e430055184e0d8fe619421e5efb10; no voters:
I20260811 14:29:35.726516 8714 raft_consensus.cc:2781] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:35.726681 8714 raft_consensus.cc:686] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 1 LEADER]: Becoming Leader. State: Replica: e27e430055184e0d8fe619421e5efb10, State: Running, Role: LEADER
I20260811 14:29:35.726781 8714 consensus_queue.cc:237] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } }
I20260811 14:29:35.727618 8188 catalog_manager.cc:5495] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 reported cstate change: term changed from 0 to 1, leader changed from <none> to e27e430055184e0d8fe619421e5efb10 (127.20.132.195). New cstate: current_term: 1 leader_uuid: "e27e430055184e0d8fe619421e5efb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27e430055184e0d8fe619421e5efb10" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 40419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260811 14:29:35.737241 8705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.734724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36312 (local address 127.20.132.195:40419)
0811 14:29:35.734784 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:35.734786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:35.734798 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:29:35.734890 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:35.734891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:35.734911 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:35.734994 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:29:35.735118 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.735583 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.736434 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:35.736631 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:35.736707 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:35.736886 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:29:35.736984 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:29:35.737080 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:35.737106 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 14:29:35.737124 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:29:35.738972 8344 raft_consensus.cc:1261] T 01b28c0de93b41f08a9364af8fed169b P 9aae6ea982c04ce2936e7380afa75dcc [term 1 FOLLOWER]: Refusing update from remote peer e27e430055184e0d8fe619421e5efb10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:35.738996 8487 raft_consensus.cc:1261] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 1 FOLLOWER]: Refusing update from remote peer e27e430055184e0d8fe619421e5efb10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:35.739362 8720 consensus_queue.cc:1035] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aae6ea982c04ce2936e7380afa75dcc" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 40511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:35.739516 8714 consensus_queue.cc:1035] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e30cdabf08143e8925409e442fe9ef2" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:35.744351 8188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:35.744447 8188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:35.745211 8188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5eff8810009484eab01c2e23144dff2: Sending DeleteTablet for 3 replicas of tablet 01b28c0de93b41f08a9364af8fed169b
I20260811 14:29:35.745594 8614 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b28c0de93b41f08a9364af8fed169b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:35 UTC) from {username='slave'} at 127.0.0.1:36310
I20260811 14:29:35.745565 8322 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b28c0de93b41f08a9364af8fed169b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:35 UTC) from {username='slave'} at 127.0.0.1:40980
I20260811 14:29:35.745831 8736 tablet_replica.cc:330] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: stopping tablet replica
I20260811 14:29:35.745823 8464 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b28c0de93b41f08a9364af8fed169b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:35 UTC) from {username='slave'} at 127.0.0.1:48028
I20260811 14:29:35.745924 8736 raft_consensus.cc:2229] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:29:35.746007 8736 raft_consensus.cc:2258] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:35.746021 8738 tablet_replica.cc:330] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: stopping tablet replica
I20260811 14:29:35.746109 8738 raft_consensus.cc:2229] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:35.746201 8738 raft_consensus.cc:2258] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:35.746454 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 8252
I20260811 14:29:35.746471 8736 ts_tablet_manager.cc:1905] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:35.750448 8736 ts_tablet_manager.cc:1918] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:35.750536 8736 log.cc:1196] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/01b28c0de93b41f08a9364af8fed169b
I20260811 14:29:35.750809 8736 ts_tablet_manager.cc:1939] T 01b28c0de93b41f08a9364af8fed169b P e27e430055184e0d8fe619421e5efb10: Deleting consensus metadata
I20260811 14:29:35.751242 8172 catalog_manager.cc:4841] TS e27e430055184e0d8fe619421e5efb10 (127.20.132.195:40419): tablet 01b28c0de93b41f08a9364af8fed169b (table test-table [id=6287feaa7fdc4fed872fbde1c654440b]) successfully deleted
I20260811 14:29:35.753783 8738 ts_tablet_manager.cc:1905] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:35.757745 8738 ts_tablet_manager.cc:1918] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:35.757871 8738 log.cc:1196] T 01b28c0de93b41f08a9364af8fed169b P 2e30cdabf08143e8925409e442fe9ef2: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/01b28c0de93b41f08a9364af8fed169b
W20260811 14:29:35.757967 8175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:40511 (error 108)
I20260811 14:29:35.758244 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 8395
I20260811 14:29:35.763100 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.758409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:40511 (local address 127.0.0.1:40996)
0811 14:29:35.762983 (+ 4574us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.763054 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:40511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4543}
W20260811 14:29:35.768399 8175 catalog_manager.cc:4584] TS 9aae6ea982c04ce2936e7380afa75dcc (127.20.132.193:40511): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 01b28c0de93b41f08a9364af8fed169b: Network error: Client connection negotiation failed: client connection to 127.20.132.193:40511: connect: Connection refused (error 111)
I20260811 14:29:35.772361 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:35.772249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:36869 (local address 127.0.0.1:48036)
0811 14:29:35.772309 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:35.772331 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.194:36869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:29:35.772372 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 8542
I20260811 14:29:35.779397 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 8152
2026-08-11T14:29:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (723 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:35 dist-test-slave-cbbz krb5kdc[8742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:35 dist-test-slave-cbbz krb5kdc[8742](info): set up 2 sockets
Aug 11 14:29:35 dist-test-slave-cbbz krb5kdc[8742](info): commencing operation
krb5kdc: starting...
W20260811 14:29:36.875793 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:36 dist-test-slave-cbbz krb5kdc[8742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:29:36.994369 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:38605
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:38605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:37.075932 8756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:37.076202 8756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:37.076242 8756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:37.077405 8756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:37.077473 8756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:37.077502 8756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:37.077531 8756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:37.077570 8756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:37.079010 8756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:38605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:38605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:37.079272 8756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:37.079489 8756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:37.084409 8764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.084483 8756 server_base.cc:1034] running on GCE node
W20260811 14:29:37.084424 8761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.084426 8762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.084900 8756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:37.085160 8756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:37.086302 8756 hybrid_clock.cc:648] HybridClock initialized: now 1786458577086294 us; error 33 us; skew 500 ppm
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:37.088871 8756 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:29:37.089350 8756 webserver.cc:460] Webserver started at http://127.20.132.254:38845/ using document root <none> and password file <none>
I20260811 14:29:37.089564 8756 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:37.089632 8756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:37.089776 8756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:37.090809 8756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "91a58fcc367d421f8f77bec1e5060a72"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "74cba073b1be84ec13c2fe63ff3bb7cf"
server_key_iv: "7ac5acbe09d9817ee2cba8a48779bced"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.091183 8756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "91a58fcc367d421f8f77bec1e5060a72"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "74cba073b1be84ec13c2fe63ff3bb7cf"
server_key_iv: "7ac5acbe09d9817ee2cba8a48779bced"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.092548 8756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:37.093277 8771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.093446 8756 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:37.093549 8756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "91a58fcc367d421f8f77bec1e5060a72"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "74cba073b1be84ec13c2fe63ff3bb7cf"
server_key_iv: "7ac5acbe09d9817ee2cba8a48779bced"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.093621 8756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:37.112790 8756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:37.114727 8756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:37.114890 8756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:37.119222 8756 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:38605
I20260811 14:29:37.119338 8827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:38605 every 8 connection(s)
I20260811 14:29:37.119644 8756 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:37.120508 8828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:37.122838 8828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72: Bootstrap starting.
I20260811 14:29:37.123445 8828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:37.123757 8828 log.cc:824] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:37.124596 8828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72: No bootstrap required, opened a new log
I20260811 14:29:37.126202 8828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a58fcc367d421f8f77bec1e5060a72" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38605 } }
I20260811 14:29:37.126343 8828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:37.126366 8828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a58fcc367d421f8f77bec1e5060a72, State: Initialized, Role: FOLLOWER
I20260811 14:29:37.126533 8828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a58fcc367d421f8f77bec1e5060a72" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38605 } }
I20260811 14:29:37.126600 8828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:37.126622 8828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:37.126650 8828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:37.127203 8828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a58fcc367d421f8f77bec1e5060a72" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38605 } }
I20260811 14:29:37.127292 8828 leader_election.cc:302] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91a58fcc367d421f8f77bec1e5060a72; no voters:
I20260811 14:29:37.127511 8828 leader_election.cc:288] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:37.127607 8831 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:37.127789 8831 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [term 1 LEADER]: Becoming Leader. State: Replica: 91a58fcc367d421f8f77bec1e5060a72, State: Running, Role: LEADER
I20260811 14:29:37.127815 8828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:37.127882 8831 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a58fcc367d421f8f77bec1e5060a72" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38605 } }
I20260811 14:29:37.128268 8836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91a58fcc367d421f8f77bec1e5060a72. Latest consensus state: current_term: 1 leader_uuid: "91a58fcc367d421f8f77bec1e5060a72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a58fcc367d421f8f77bec1e5060a72" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38605 } } }
I20260811 14:29:37.128357 8836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:37.128510 8834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91a58fcc367d421f8f77bec1e5060a72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a58fcc367d421f8f77bec1e5060a72" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 38605 } } }
I20260811 14:29:37.128614 8842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:37.128629 8834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:37.129355 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 8756
I20260811 14:29:37.129387 8842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:37.129492 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:37.129720 21011 external_mini_cluster.cc:1428] Setting key 5ee18a599b94aec639e8d449d5119de5
I20260811 14:29:37.131620 8842 catalog_manager.cc:1347] Generated new cluster ID: ed1df191dc544b1682ceff3e124a414b
I20260811 14:29:37.131671 8842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:37.141338 8842 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:37.142081 8842 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:37.146277 8842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72: Generated new TSK 0
I20260811 14:29:37.146446 8842 catalog_manager.cc:1514] Initializing in-progress tserver states...
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:37.151688 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.130234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45164 (local address 127.20.132.254:38605)
0811 14:29:37.130400 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.130408 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.130443 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:29:37.130583 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.130590 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.130654 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.139234 (+ 8580us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:37.139348 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.141216 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.142527 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.145019 (+ 2492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.145581 (+ 562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.148204 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:37.148209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:37.148209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:37.148222 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:37.150091 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.150440 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.150443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.150444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.150557 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.150746 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.150747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.150747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.151054 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:37.151194 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.151290 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.151446 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:29:37.179792 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38605
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:37.262622 8857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:37.262861 8857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:37.262899 8857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:37.264096 8857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:37.264178 8857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:37.264235 8857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:37.265709 8857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:37.265976 8857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:37.266206 8857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:37.271276 8863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.271450 8857 server_base.cc:1034] running on GCE node
W20260811 14:29:37.271318 8865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.271287 8862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.271786 8857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:37.272044 8857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:37.273185 8857 hybrid_clock.cc:648] HybridClock initialized: now 1786458577273183 us; error 36 us; skew 500 ppm
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:37.275674 8857 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:29:37.276129 8857 webserver.cc:460] Webserver started at http://127.20.132.193:40907/ using document root <none> and password file <none>
I20260811 14:29:37.276419 8857 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:37.276463 8857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:37.276608 8857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:37.277614 8857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "db7b9baab3f34188b50cccc5b0b878a6"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "60ec1ca5ab258b67899570c209a93bdd"
server_key_iv: "0f94c787b479017733dbee3039b5c98f"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.277972 8857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "db7b9baab3f34188b50cccc5b0b878a6"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "60ec1ca5ab258b67899570c209a93bdd"
server_key_iv: "0f94c787b479017733dbee3039b5c98f"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.279305 8857 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:29:37.279990 8874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.280223 8857 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:29:37.280313 8857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "db7b9baab3f34188b50cccc5b0b878a6"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "60ec1ca5ab258b67899570c209a93bdd"
server_key_iv: "0f94c787b479017733dbee3039b5c98f"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.280380 8857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:37.320566 8857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:37.323012 8857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:37.323153 8857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:37.323434 8857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:37.323769 8857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:37.323807 8857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.323830 8857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:37.323868 8857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.330312 8857 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:36745
I20260811 14:29:37.330391 9000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:36745 every 8 connection(s)
I20260811 14:29:37.330710 8857 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:29:37.335917 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 8857
I20260811 14:29:37.336066 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:29:37.336347 21011 external_mini_cluster.cc:1428] Setting key 4ac6368f810fa14da3bf5ae8238311f7
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:37.341369 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.331480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:57031 (local address 127.20.132.254:38605)
0811 14:29:37.331589 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.331592 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.331755 (+ 163us) server_negotiation.cc:407] Connection header received
0811 14:29:37.332511 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.332513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.332527 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.332611 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:37.333701 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.334211 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.335170 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.335377 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.335445 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.338085 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:37.338086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:37.338087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:37.338094 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:37.339861 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.340346 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.340347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.340348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.340417 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.340687 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.340688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.340688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.340808 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:37.340884 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.341175 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.341279 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:29:37.341531 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.331431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38605 (local address 127.20.132.193:57031)
0811 14:29:37.331622 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.331659 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.332388 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.332699 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.332714 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.333422 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:37.333618 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.333624 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.334292 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.334293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.335070 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.335071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.335460 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.335461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.335561 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.336168 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:37.336179 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:37.337993 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:37.339957 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:37.339964 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:37.339966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:37.340261 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:37.340491 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:37.340492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:37.340492 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:37.340608 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:37.340885 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:37.340893 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:37.341030 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.341135 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.341295 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260811 14:29:37.342052 9001 heartbeater.cc:347] Connected to a master server at 127.20.132.254:38605
I20260811 14:29:37.342154 9001 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:37.342357 9001 heartbeater.cc:511] Master 127.20.132.254:38605 requested a full tablet report, sending...
I20260811 14:29:37.342949 8789 ts_manager.cc:194] Registered new tserver with Master: db7b9baab3f34188b50cccc5b0b878a6 (127.20.132.193:36745)
I20260811 14:29:37.343859 8789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:57031
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:29:37.363843 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38605
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:37.446768 9006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:37.446982 9006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:37.447006 9006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:37.448227 9006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:37.448269 9006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:37.448297 9006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:37.449757 9006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:37.449993 9006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:37.450241 9006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:37.455322 9011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.455314 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.455435 9013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.455536 9006 server_base.cc:1034] running on GCE node
I20260811 14:29:37.455736 9006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:37.455941 9006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:37.457083 9006 hybrid_clock.cc:648] HybridClock initialized: now 1786458577457059 us; error 37 us; skew 500 ppm
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:37.459698 9006 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:29:37.460073 9006 webserver.cc:460] Webserver started at http://127.20.132.194:44721/ using document root <none> and password file <none>
I20260811 14:29:37.460337 9006 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:37.460412 9006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:37.460563 9006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:37.461617 9006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "33425209df954c4e4fa23f782b32eb57"
server_key_iv: "69fcb1452dfb2c8e009d5834fd7b6d12"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.462000 9006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "33425209df954c4e4fa23f782b32eb57"
server_key_iv: "69fcb1452dfb2c8e009d5834fd7b6d12"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.463351 9006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:37.464107 9026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.464344 9006 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:37.464442 9006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "33425209df954c4e4fa23f782b32eb57"
server_key_iv: "69fcb1452dfb2c8e009d5834fd7b6d12"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.464535 9006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:37.475378 9006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:37.477507 9006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:37.477671 9006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:37.477909 9006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:37.478226 9006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:37.478281 9006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.478323 9006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:37.478353 9006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.484675 9006 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:39671
I20260811 14:29:37.484779 9152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:39671 every 8 connection(s)
I20260811 14:29:37.485083 9006 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:29:37.489218 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9006
I20260811 14:29:37.489342 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:29:37.489579 21011 external_mini_cluster.cc:1428] Setting key 19687823f5bf6664658815520118c17d
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:37.495080 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.485838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:45219 (local address 127.20.132.254:38605)
0811 14:29:37.485924 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.485927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.486070 (+ 143us) server_negotiation.cc:407] Connection header received
0811 14:29:37.486553 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.486555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.486569 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.486627 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:37.487551 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.488055 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.489099 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.489413 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.489497 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.492099 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:37.492100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:37.492101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:37.492115 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:37.493597 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.494045 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.494046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.494047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.494107 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.494405 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.494407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.494407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.494531 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:37.494606 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.494899 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.494986 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:29:37.495464 9156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.485782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38605 (local address 127.20.132.194:45219)
0811 14:29:37.485944 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.485982 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.486470 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.486673 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.486676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.487268 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:37.487461 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.487465 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.488192 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.488193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.489016 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.489018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.489504 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.489505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.489609 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.490334 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:37.490343 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:37.491982 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:37.493710 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:37.493717 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:37.493719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:37.493953 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:37.494180 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:37.494181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:37.494182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:37.494323 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:37.494609 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:37.494617 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:37.494765 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.494878 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.495044 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260811 14:29:37.495991 9153 heartbeater.cc:347] Connected to a master server at 127.20.132.254:38605
I20260811 14:29:37.496078 9153 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:37.496325 9153 heartbeater.cc:511] Master 127.20.132.254:38605 requested a full tablet report, sending...
I20260811 14:29:37.496886 8789 ts_manager.cc:194] Registered new tserver with Master: 08c2bcd29d974aa08ec69b04e0fbc0c5 (127.20.132.194:39671)
I20260811 14:29:37.497228 8789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:45219
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:29:37.519177 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38605
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:37.602080 9161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:37.602291 9161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:37.602315 9161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:37.603502 9161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:37.603547 9161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:37.603575 9161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:37.605099 9161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:38605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:37.605352 9161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:37.605582 9161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:37.610608 9167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.610658 9166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.610616 9170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.610831 9161 server_base.cc:1034] running on GCE node
I20260811 14:29:37.611034 9161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:37.611239 9161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:37.612372 9161 hybrid_clock.cc:648] HybridClock initialized: now 1786458577612366 us; error 31 us; skew 500 ppm
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:37.614876 9161 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:29:37.615350 9161 webserver.cc:460] Webserver started at http://127.20.132.195:34599/ using document root <none> and password file <none>
I20260811 14:29:37.615573 9161 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:37.615641 9161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:37.615805 9161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:37.616921 9161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "abdf3a585f8143d994e534c3f260dabc"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "f48031bd78fe43bdf8a2a00265e44d3d"
server_key_iv: "d6e439b12008a3f49576816d57406bfb"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.617290 9161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "abdf3a585f8143d994e534c3f260dabc"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "f48031bd78fe43bdf8a2a00265e44d3d"
server_key_iv: "d6e439b12008a3f49576816d57406bfb"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.618661 9161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 14:29:37.619429 9178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.619616 9161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:37.619729 9161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "abdf3a585f8143d994e534c3f260dabc"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "f48031bd78fe43bdf8a2a00265e44d3d"
server_key_iv: "d6e439b12008a3f49576816d57406bfb"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.619807 9161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:37.637138 9161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:37.639766 9161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:37.639945 9161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:37.640266 9161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:37.640605 9161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:37.640662 9161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.640714 9161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:37.640741 9161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.647154 9161 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:37387
I20260811 14:29:37.647199 9301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:37387 every 8 connection(s)
I20260811 14:29:37.647537 9161 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
Aug 11 14:29:37 dist-test-slave-cbbz krb5kdc[8742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458577, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:37.654764 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9161
I20260811 14:29:37.654850 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:29:37.655113 21011 external_mini_cluster.cc:1428] Setting key deaa1b9752d46997d2888a284fce6717
I20260811 14:29:37.657054 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.648245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:47597 (local address 127.20.132.254:38605)
0811 14:29:37.648320 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.648323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.648576 (+ 253us) server_negotiation.cc:407] Connection header received
0811 14:29:37.649068 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.649069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.649079 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.649133 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:37.650064 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.650555 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.651651 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.651939 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.651998 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.654245 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:37.654246 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:37.654246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:37.654253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:37.655896 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.656367 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.656368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.656368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.656421 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.656602 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.656603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.656603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.656695 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:37.656739 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.656934 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.656992 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:29:37.657274 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.648254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:38605 (local address 127.20.132.195:47597)
0811 14:29:37.648440 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.648480 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.648972 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.649184 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.649187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.649791 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:37.649985 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.649990 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.650660 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.650661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.651495 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.651497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.652021 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.652022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.652185 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.652682 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:37.652691 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:37.654153 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:37.655962 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:37.655968 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:37.655970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:37.656300 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:37.656467 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:37.656468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:37.656468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:37.656555 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:37.656736 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:37.656738 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:37.656846 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.656914 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.657029 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260811 14:29:37.657678 9302 heartbeater.cc:347] Connected to a master server at 127.20.132.254:38605
I20260811 14:29:37.657771 9302 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:37.657917 9302 heartbeater.cc:511] Master 127.20.132.254:38605 requested a full tablet report, sending...
I20260811 14:29:37.658233 8789 ts_manager.cc:194] Registered new tserver with Master: abdf3a585f8143d994e534c3f260dabc (127.20.132.195:37387)
I20260811 14:29:37.658581 8789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:47597
I20260811 14:29:37.667289 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:29:37.674984 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.668846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45168 (local address 127.20.132.254:38605)
0811 14:29:37.668891 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.668893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.669013 (+ 120us) server_negotiation.cc:407] Connection header received
0811 14:29:37.669054 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.669055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.669063 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.669136 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:37.669685 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.670192 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.670907 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.671106 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.671158 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.672546 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:37.672547 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:37.672547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:37.672554 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:37.673964 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.674336 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.674337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.674337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.674391 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:37.674570 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:37.674570 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:37.674570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:37.674695 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:37.674771 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.674868 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.674917 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:29:37.676921 8789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:29:37.678488 8789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:29:37.685194 9316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.680789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39671 (local address 127.0.0.1:35216)
0811 14:29:37.680960 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.681002 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.681070 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.681459 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.681462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.681465 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:37.681551 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.681553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.682727 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.682729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.683945 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.683948 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.684876 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.684877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.684958 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.684972 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.685049 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.685112 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":47,"threads_started":1}
I20260811 14:29:37.685235 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.680976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35216 (local address 127.20.132.194:39671)
0811 14:29:37.681290 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.681297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.681309 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:29:37.681352 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.681354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.681370 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.681455 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:37.681644 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.682626 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.684031 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.684783 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.684866 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.684924 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.685078 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.685127 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":82,"threads_started":1}
I20260811 14:29:37.685604 9315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.680795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:37387 (local address 127.0.0.1:33550)
0811 14:29:37.681093 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.681104 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.681159 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.681699 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.681700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.681702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:37.681742 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.681743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.683171 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.683172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.684273 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.684275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.685214 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.685215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.685431 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.685435 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.685469 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.685515 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":100,"threads_started":1}
I20260811 14:29:37.686061 9317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.680895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33550 (local address 127.20.132.195:37387)
0811 14:29:37.681525 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.681529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.681539 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:29:37.681585 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.681588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.681604 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.681837 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:37.681916 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.683056 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.684368 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.685112 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.685808 (+ 696us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.685876 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.685904 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.685954 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":95,"threads_started":1}
I20260811 14:29:37.686223 9079 tablet_service.cc:1467] Processing CreateTablet for tablet bf21382694a54205885f579940ef2cd7 (DEFAULT_TABLE table=test-table [id=ac176beaafcf4eaab256898d58a68e85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:37.686601 9079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf21382694a54205885f579940ef2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:37.688902 9321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.681231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40896 (local address 127.20.132.193:36745)
0811 14:29:37.681434 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.681440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.681452 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:29:37.681496 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.681498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.681514 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.681874 (+ 360us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:37.681958 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.683045 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.685143 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.688481 (+ 3338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.688591 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.688643 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.688751 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.688802 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":101,"threads_started":1}
I20260811 14:29:37.688848 9230 tablet_service.cc:1467] Processing CreateTablet for tablet bf21382694a54205885f579940ef2cd7 (DEFAULT_TABLE table=test-table [id=ac176beaafcf4eaab256898d58a68e85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:37.689190 9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf21382694a54205885f579940ef2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:37.689224 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.680977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36745 (local address 127.0.0.1:40896)
0811 14:29:37.681310 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.681318 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.681388 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.681646 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.681647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.681649 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:37.681702 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.681704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.684211 (+ 2507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.684212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.685054 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.685057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.688593 (+ 3536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.688594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.688657 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.688662 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.688734 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.689142 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":75,"threads_started":1}
I20260811 14:29:37.689716 9322 tablet_bootstrap.cc:492] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Bootstrap starting.
I20260811 14:29:37.690356 9322 tablet_bootstrap.cc:654] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:37.690864 9322 log.cc:824] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:37.691696 9322 tablet_bootstrap.cc:492] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: No bootstrap required, opened a new log
I20260811 14:29:37.691799 9322 ts_tablet_manager.cc:1397] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:29:37.692195 9324 tablet_bootstrap.cc:492] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Bootstrap starting.
I20260811 14:29:37.692871 9324 tablet_bootstrap.cc:654] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:37.692960 8925 tablet_service.cc:1467] Processing CreateTablet for tablet bf21382694a54205885f579940ef2cd7 (DEFAULT_TABLE table=test-table [id=ac176beaafcf4eaab256898d58a68e85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:37.693285 8925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf21382694a54205885f579940ef2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:37.693439 9324 log.cc:824] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:37.694131 9324 tablet_bootstrap.cc:492] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: No bootstrap required, opened a new log
I20260811 14:29:37.694185 9324 ts_tablet_manager.cc:1397] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:37.695510 9324 raft_consensus.cc:348] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.695652 9324 raft_consensus.cc:374] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:37.695673 9324 raft_consensus.cc:729] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf3a585f8143d994e534c3f260dabc, State: Initialized, Role: FOLLOWER
I20260811 14:29:37.695816 9324 consensus_queue.cc:260] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.696019 9328 tablet_bootstrap.cc:492] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: Bootstrap starting.
I20260811 14:29:37.696164 9324 ts_tablet_manager.cc:1428] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:37.696321 9302 heartbeater.cc:503] Master 127.20.132.254:38605 was elected leader, sending a full tablet report...
I20260811 14:29:37.696758 9328 tablet_bootstrap.cc:654] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:37.697407 9328 log.cc:824] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:37.698100 9322 raft_consensus.cc:348] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.698236 9328 tablet_bootstrap.cc:492] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: No bootstrap required, opened a new log
I20260811 14:29:37.698263 9322 raft_consensus.cc:374] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:37.698287 9322 raft_consensus.cc:729] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c2bcd29d974aa08ec69b04e0fbc0c5, State: Initialized, Role: FOLLOWER
I20260811 14:29:37.698311 9328 ts_tablet_manager.cc:1397] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:29:37.698414 9322 consensus_queue.cc:260] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.698761 9322 ts_tablet_manager.cc:1428] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 14:29:37.698773 9153 heartbeater.cc:503] Master 127.20.132.254:38605 was elected leader, sending a full tablet report...
I20260811 14:29:37.700400 9328 raft_consensus.cc:348] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.700524 9328 raft_consensus.cc:374] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:37.700546 9328 raft_consensus.cc:729] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db7b9baab3f34188b50cccc5b0b878a6, State: Initialized, Role: FOLLOWER
I20260811 14:29:37.700618 9328 consensus_queue.cc:260] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.700881 9328 ts_tablet_manager.cc:1428] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:29:37.700928 9001 heartbeater.cc:503] Master 127.20.132.254:38605 was elected leader, sending a full tablet report...
I20260811 14:29:37.726250 9334 raft_consensus.cc:482] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:37.726439 9334 raft_consensus.cc:504] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.726902 9334 leader_election.cc:288] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08c2bcd29d974aa08ec69b04e0fbc0c5 (127.20.132.194:39671), abdf3a585f8143d994e534c3f260dabc (127.20.132.195:37387)
I20260811 14:29:37.731051 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.727204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:56363 (local address 127.20.132.194:39671)
0811 14:29:37.727264 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.727266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.727431 (+ 165us) server_negotiation.cc:407] Connection header received
0811 14:29:37.727480 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.727481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.727491 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.727580 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:37.727729 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.728472 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.730029 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.730661 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.730747 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.730756 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.730935 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.730976 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 14:29:37.731073 9317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.727178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:46005 (local address 127.20.132.195:37387)
0811 14:29:37.727234 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.727236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.727244 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:29:37.727273 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.727274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.727284 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.727336 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:37.727605 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.728468 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.730036 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.730660 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.730747 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.730756 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.730936 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.730976 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:29:37.731074 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.727061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:37387 (local address 127.20.132.193:46005)
0811 14:29:37.727118 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.727130 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.727172 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.727390 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.727391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.727393 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:37.727512 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.727514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.728560 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.728561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.729930 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.729933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.730754 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.730755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.730837 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.730839 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.730896 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.730973 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":87}
I20260811 14:29:37.731081 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.727092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:39671 (local address 127.20.132.193:56363)
0811 14:29:37.727359 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.727369 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:37.727421 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:37.727582 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:37.727583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:37.727585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:37.727658 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.727659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.728565 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.728566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.729930 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:37.729933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.730754 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.730755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:37.730835 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.730839 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:37.730896 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 14:29:37.730972 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":72,"thread_start_us":125,"threads_started":1}
I20260811 14:29:37.731472 9252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf21382694a54205885f579940ef2cd7" candidate_uuid: "db7b9baab3f34188b50cccc5b0b878a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf3a585f8143d994e534c3f260dabc" is_pre_election: true
I20260811 14:29:37.731659 9252 raft_consensus.cc:2454] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db7b9baab3f34188b50cccc5b0b878a6 in term 0.
I20260811 14:29:37.731724 9102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf21382694a54205885f579940ef2cd7" candidate_uuid: "db7b9baab3f34188b50cccc5b0b878a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" is_pre_election: true
I20260811 14:29:37.731901 9102 raft_consensus.cc:2454] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db7b9baab3f34188b50cccc5b0b878a6 in term 0.
I20260811 14:29:37.731899 8879 leader_election.cc:302] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abdf3a585f8143d994e534c3f260dabc, db7b9baab3f34188b50cccc5b0b878a6; no voters:
I20260811 14:29:37.732028 9334 raft_consensus.cc:2781] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:29:37.732087 9334 raft_consensus.cc:482] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:37.732110 9334 raft_consensus.cc:3037] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:37.732882 9334 raft_consensus.cc:504] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
I20260811 14:29:37.733090 9334 leader_election.cc:288] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [CANDIDATE]: Term 1 election: Requested vote from peers 08c2bcd29d974aa08ec69b04e0fbc0c5 (127.20.132.194:39671), abdf3a585f8143d994e534c3f260dabc (127.20.132.195:37387)
I20260811 14:29:37.733237 9102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf21382694a54205885f579940ef2cd7" candidate_uuid: "db7b9baab3f34188b50cccc5b0b878a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5"
I20260811 14:29:37.733265 9252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf21382694a54205885f579940ef2cd7" candidate_uuid: "db7b9baab3f34188b50cccc5b0b878a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf3a585f8143d994e534c3f260dabc"
I20260811 14:29:37.733323 9102 raft_consensus.cc:3037] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:37.733333 9252 raft_consensus.cc:3037] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:37.734267 9252 raft_consensus.cc:2454] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db7b9baab3f34188b50cccc5b0b878a6 in term 1.
I20260811 14:29:37.734267 9102 raft_consensus.cc:2454] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db7b9baab3f34188b50cccc5b0b878a6 in term 1.
I20260811 14:29:37.734462 8877 leader_election.cc:302] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c2bcd29d974aa08ec69b04e0fbc0c5, db7b9baab3f34188b50cccc5b0b878a6; no voters:
I20260811 14:29:37.734592 9334 raft_consensus.cc:2781] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:37.734776 9334 raft_consensus.cc:686] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [term 1 LEADER]: Becoming Leader. State: Replica: db7b9baab3f34188b50cccc5b0b878a6, State: Running, Role: LEADER
I20260811 14:29:37.734884 9334 consensus_queue.cc:237] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } }
W20260811 14:29:37.735636 9154 tablet.cc:2369] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:29:37.735754 8788 catalog_manager.cc:5495] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to db7b9baab3f34188b50cccc5b0b878a6 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "db7b9baab3f34188b50cccc5b0b878a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db7b9baab3f34188b50cccc5b0b878a6" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 36745 } health_report { overall_health: HEALTHY } } }
I20260811 14:29:37.743130 9321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.740673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40898 (local address 127.20.132.193:36745)
0811 14:29:37.740731 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.740733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.740741 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:29:37.740824 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.740824 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.740845 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.740927 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:29:37.741078 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.741544 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.742310 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.742506 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.742580 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.742762 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:29:37.742852 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:29:37.742953 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.743019 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.743029 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 14:29:37.744839 9102 raft_consensus.cc:1261] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 1 FOLLOWER]: Refusing update from remote peer db7b9baab3f34188b50cccc5b0b878a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:37.744846 9252 raft_consensus.cc:1261] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 1 FOLLOWER]: Refusing update from remote peer db7b9baab3f34188b50cccc5b0b878a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:37.745198 9334 consensus_queue.cc:1035] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c2bcd29d974aa08ec69b04e0fbc0c5" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 39671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:37.745374 9336 consensus_queue.cc:1035] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf3a585f8143d994e534c3f260dabc" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 37387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:37.747960 9339 mvcc.cc:205] Tried to move back new op lower bound from 7317334334440341504 to 7317334334402826240. Current Snapshot: MvccSnapshot[applied={T|T < 7317334334440341504}]
I20260811 14:29:37.748898 9341 mvcc.cc:205] Tried to move back new op lower bound from 7317334334440341504 to 7317334334402826240. Current Snapshot: MvccSnapshot[applied={T|T < 7317334334440341504}]
I20260811 14:29:37.751066 8789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:37.751151 8789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:37.751965 8789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91a58fcc367d421f8f77bec1e5060a72: Sending DeleteTablet for 3 replicas of tablet bf21382694a54205885f579940ef2cd7
I20260811 14:29:37.752357 9230 tablet_service.cc:1514] Processing DeleteTablet for tablet bf21382694a54205885f579940ef2cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:37 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:33550
I20260811 14:29:37.752336 9079 tablet_service.cc:1514] Processing DeleteTablet for tablet bf21382694a54205885f579940ef2cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:37 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:35216
I20260811 14:29:37.752645 8925 tablet_service.cc:1514] Processing DeleteTablet for tablet bf21382694a54205885f579940ef2cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:37 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:40896
I20260811 14:29:37.752882 9349 tablet_replica.cc:330] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: stopping tablet replica
I20260811 14:29:37.752875 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 8857
I20260811 14:29:37.752880 9351 tablet_replica.cc:330] T bf21382694a54205885f579940ef2cd7 P db7b9baab3f34188b50cccc5b0b878a6: stopping tablet replica
I20260811 14:29:37.753531 9349 raft_consensus.cc:2229] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:37.753655 9349 raft_consensus.cc:2258] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:37.755937 9348 tablet_replica.cc:330] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: stopping tablet replica
I20260811 14:29:37.756064 9348 raft_consensus.cc:2229] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:37.756211 9348 raft_consensus.cc:2258] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:37.756376 9349 ts_tablet_manager.cc:1905] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:37.756690 9348 ts_tablet_manager.cc:1905] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:37.758361 9349 ts_tablet_manager.cc:1918] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:37.758400 9348 ts_tablet_manager.cc:1918] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:37.758446 9349 log.cc:1196] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/bf21382694a54205885f579940ef2cd7
I20260811 14:29:37.758457 9348 log.cc:1196] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/bf21382694a54205885f579940ef2cd7
I20260811 14:29:37.758766 9348 ts_tablet_manager.cc:1939] T bf21382694a54205885f579940ef2cd7 P abdf3a585f8143d994e534c3f260dabc: Deleting consensus metadata
I20260811 14:29:37.758785 9349 ts_tablet_manager.cc:1939] T bf21382694a54205885f579940ef2cd7 P 08c2bcd29d974aa08ec69b04e0fbc0c5: Deleting consensus metadata
I20260811 14:29:37.759202 8773 catalog_manager.cc:4841] TS 08c2bcd29d974aa08ec69b04e0fbc0c5 (127.20.132.194:39671): tablet bf21382694a54205885f579940ef2cd7 (table test-table [id=ac176beaafcf4eaab256898d58a68e85]) successfully deleted
I20260811 14:29:37.759269 8775 catalog_manager.cc:4841] TS abdf3a585f8143d994e534c3f260dabc (127.20.132.195:37387): tablet bf21382694a54205885f579940ef2cd7 (table test-table [id=ac176beaafcf4eaab256898d58a68e85]) successfully deleted
W20260811 14:29:37.759999 8773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:36745 (error 108)
I20260811 14:29:37.760258 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9006
I20260811 14:29:37.764200 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.763991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:36745 (local address 127.0.0.1:40906)
0811 14:29:37.764055 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:37.764128 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:36745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 14:29:37.764343 8773 catalog_manager.cc:4584] TS db7b9baab3f34188b50cccc5b0b878a6 (127.20.132.193:36745): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bf21382694a54205885f579940ef2cd7: Network error: Client connection negotiation failed: client connection to 127.20.132.193:36745: connect: Connection refused (error 111)
I20260811 14:29:37.767580 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9161
I20260811 14:29:37.778991 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 8756
2026-08-11T14:29:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2001 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T14:29:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:37Z Disabled control of system clock
I20260811 14:29:37.808691 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37793
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:40179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:37.889410 9356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:37.889621 9356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:37.889642 9356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:37.890801 9356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:37.890856 9356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:37.890867 9356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:37.890880 9356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:37.890892 9356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:37.892297 9356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37793
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:37.892551 9356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:37.892860 9356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:37.897972 9361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.897981 9363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:37.897976 9365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:37.898346 9356 server_base.cc:1034] running on GCE node
I20260811 14:29:37.898584 9356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:37.898871 9356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:37.900002 9356 hybrid_clock.cc:648] HybridClock initialized: now 1786458577899969 us; error 49 us; skew 500 ppm
I20260811 14:29:37.901350 9356 webserver.cc:460] Webserver started at http://127.20.132.254:40649/ using document root <none> and password file <none>
I20260811 14:29:37.901599 9356 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:37.901645 9356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:37.901841 9356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:37.902918 9356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "9c722d63f34042929f3daeda4fcd0f86"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "8c8d5857b1083b3dbb81363719e16c97"
server_key_iv: "b96b35dbfb941d3710d8aa66d6109d7e"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.903298 9356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "9c722d63f34042929f3daeda4fcd0f86"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "8c8d5857b1083b3dbb81363719e16c97"
server_key_iv: "b96b35dbfb941d3710d8aa66d6109d7e"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.904726 9356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:37.905540 9371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:37.905718 9356 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:37.905824 9356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "9c722d63f34042929f3daeda4fcd0f86"
format_stamp: "Formatted at 2026-08-11 14:29:37 on dist-test-slave-cbbz"
server_key: "8c8d5857b1083b3dbb81363719e16c97"
server_key_iv: "b96b35dbfb941d3710d8aa66d6109d7e"
server_key_version: "encryptionkey@0"
I20260811 14:29:37.905901 9356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:37.927559 9356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:37.927923 9356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:37.928094 9356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:37.932159 9356 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37793
I20260811 14:29:37.932248 9427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37793 every 8 connection(s)
I20260811 14:29:37.932600 9356 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:37.933347 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9356
I20260811 14:29:37.933487 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:37.933653 9428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:37.933724 21011 external_mini_cluster.cc:1428] Setting key a6a7727d9b22111791ab1c1d33cb46bd
I20260811 14:29:37.937194 9428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86: Bootstrap starting.
I20260811 14:29:37.937813 9428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:37.938119 9428 log.cc:824] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:37.939028 9428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86: No bootstrap required, opened a new log
I20260811 14:29:37.939986 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:37.934308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44284 (local address 127.20.132.254:37793)
0811 14:29:37.934544 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:37.934553 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:37.934587 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:29:37.935289 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:37.935299 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:37.935384 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:37.935540 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:37.935774 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.937151 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.937998 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:37.938450 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:37.938585 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:37.939385 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:37.939389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:37.939389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:37.939547 (+ 158us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:37.939581 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:37.939591 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:37.939662 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:37.939744 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 14:29:37.939830 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260811 14:29:37.941250 9428 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c722d63f34042929f3daeda4fcd0f86" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37793 } }
I20260811 14:29:37.941407 9428 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:37.941454 9428 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c722d63f34042929f3daeda4fcd0f86, State: Initialized, Role: FOLLOWER
I20260811 14:29:37.941577 9428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c722d63f34042929f3daeda4fcd0f86" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37793 } }
I20260811 14:29:37.941659 9428 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:37.941709 9428 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:37.941759 9428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:37.942389 9428 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c722d63f34042929f3daeda4fcd0f86" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37793 } }
I20260811 14:29:37.942509 9428 leader_election.cc:302] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c722d63f34042929f3daeda4fcd0f86; no voters:
I20260811 14:29:37.942698 9428 leader_election.cc:288] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:37.942756 9434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:37.942904 9434 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9c722d63f34042929f3daeda4fcd0f86, State: Running, Role: LEADER
I20260811 14:29:37.942974 9428 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:37.942997 9434 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c722d63f34042929f3daeda4fcd0f86" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37793 } }
I20260811 14:29:37.943390 9436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c722d63f34042929f3daeda4fcd0f86. Latest consensus state: current_term: 1 leader_uuid: "9c722d63f34042929f3daeda4fcd0f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c722d63f34042929f3daeda4fcd0f86" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37793 } } }
I20260811 14:29:37.943390 9435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c722d63f34042929f3daeda4fcd0f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c722d63f34042929f3daeda4fcd0f86" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37793 } } }
I20260811 14:29:37.943532 9436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:37.943575 9435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:37.943974 9444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:37.944483 9444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:37.945953 9444 catalog_manager.cc:1347] Generated new cluster ID: 9e33c9f4a5ae43859a846d4f78ee3814
I20260811 14:29:37.946015 9444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:37.952028 9444 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:37.952746 9444 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:37.957203 9444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86: Generated new TSK 0
I20260811 14:29:37.957369 9444 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:37.962158 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37793
--builtin_ntp_servers=127.20.132.212:40179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:38.046098 9455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:38.046367 9455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:38.046404 9455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:38.047569 9455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:38.047634 9455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:38.047678 9455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:38.049137 9455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:38.049398 9455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:38.049695 9455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:38.054741 9465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:38.054811 9461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:38.054772 9462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:38.055051 9455 server_base.cc:1034] running on GCE node
I20260811 14:29:38.055274 9455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:38.055562 9455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:38.056720 9455 hybrid_clock.cc:648] HybridClock initialized: now 1786458578056707 us; error 31 us; skew 500 ppm
I20260811 14:29:38.057974 9455 webserver.cc:460] Webserver started at http://127.20.132.193:37471/ using document root <none> and password file <none>
I20260811 14:29:38.058223 9455 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:38.058290 9455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:38.058427 9455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:38.059485 9455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "1676c9edff04418993bde91544ab4a8a"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "5021182753f8db614a3b4ad16605b6da"
server_key_iv: "9e26a6abe8f6363a471cbca625f5d1f9"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.059856 9455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "1676c9edff04418993bde91544ab4a8a"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "5021182753f8db614a3b4ad16605b6da"
server_key_iv: "9e26a6abe8f6363a471cbca625f5d1f9"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.061283 9455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:38.062119 9474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.062316 9455 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:38.062414 9455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "1676c9edff04418993bde91544ab4a8a"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "5021182753f8db614a3b4ad16605b6da"
server_key_iv: "9e26a6abe8f6363a471cbca625f5d1f9"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.062500 9455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:38.074374 9455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:38.074676 9455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:38.074826 9455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:38.075053 9455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:38.075383 9455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:38.075440 9455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.075476 9455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:38.075502 9455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.081373 9455 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:38921
I20260811 14:29:38.081423 9597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:38921 every 8 connection(s)
I20260811 14:29:38.081748 9455 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:29:38.086702 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.082429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:50533 (local address 127.20.132.254:37793)
0811 14:29:38.082498 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.082500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.082772 (+ 272us) server_negotiation.cc:407] Connection header received
0811 14:29:38.083244 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.083245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.083259 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.083318 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:38.083989 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.084494 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.085439 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.085639 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.085698 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.086467 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:38.086469 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:38.086469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:38.086473 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:38.086486 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:38.086490 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:38.086533 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.086613 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.086640 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 14:29:38.086896 9600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.082421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37793 (local address 127.20.132.193:50533)
0811 14:29:38.082645 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.082679 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.083158 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.083393 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.083397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.083405 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:38.083906 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.083910 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.084573 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.084573 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.085356 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.085358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.085724 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.085725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.085833 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.086338 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:38.086339 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:38.086368 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:38.086391 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:38.086543 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:38.086547 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:38.086549 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.086601 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.086680 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":113,"threads_started":1}
I20260811 14:29:38.087496 9598 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37793
I20260811 14:29:38.087611 9598 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:38.087814 9598 heartbeater.cc:511] Master 127.20.132.254:37793 requested a full tablet report, sending...
I20260811 14:29:38.087925 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9455
I20260811 14:29:38.088065 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:29:38.088306 21011 external_mini_cluster.cc:1428] Setting key 7a0b320d79d2f14b601160fb4c2f9cf0
I20260811 14:29:38.088413 9390 ts_manager.cc:194] Registered new tserver with Master: 1676c9edff04418993bde91544ab4a8a (127.20.132.193:38921)
I20260811 14:29:38.089247 9390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.193:50533
I20260811 14:29:38.089321 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37793
--builtin_ntp_servers=127.20.132.212:40179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:38.173874 9601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:38.174088 9601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:38.174113 9601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:38.175323 9601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:38.175369 9601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:38.175395 9601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:38.176898 9601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:38.177234 9601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:38.177568 9601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:38.182847 9610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:38.182873 9606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:38.182896 9601 server_base.cc:1034] running on GCE node
W20260811 14:29:38.182847 9608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:38.183395 9601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:38.183650 9601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:38.184823 9601 hybrid_clock.cc:648] HybridClock initialized: now 1786458578184807 us; error 48 us; skew 500 ppm
I20260811 14:29:38.186149 9601 webserver.cc:460] Webserver started at http://127.20.132.194:36607/ using document root <none> and password file <none>
I20260811 14:29:38.186421 9601 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:38.186493 9601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:38.186645 9601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:38.187752 9601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "58cd2a6d1d1a45d19abff76b0de4f50e"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "072a43a4dfb0ee411183ae4e076b93e0"
server_key_iv: "1038fda5c9b4f41a4660fb4b982db592"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.188126 9601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "58cd2a6d1d1a45d19abff76b0de4f50e"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "072a43a4dfb0ee411183ae4e076b93e0"
server_key_iv: "1038fda5c9b4f41a4660fb4b982db592"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.189505 9601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:38.190246 9616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.190423 9601 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:29:38.190515 9601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "58cd2a6d1d1a45d19abff76b0de4f50e"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "072a43a4dfb0ee411183ae4e076b93e0"
server_key_iv: "1038fda5c9b4f41a4660fb4b982db592"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.190601 9601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:38.214713 9601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:38.215058 9601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:38.215219 9601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:38.215479 9601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:38.215842 9601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:38.215900 9601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.215937 9601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:38.215981 9601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.221851 9601 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:37893
I20260811 14:29:38.221930 9742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:37893 every 8 connection(s)
I20260811 14:29:38.222303 9601 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:29:38.224604 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9601
I20260811 14:29:38.224727 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:29:38.224951 21011 external_mini_cluster.cc:1428] Setting key 2d00698ef59ac46b3ba984642d41b9ca
I20260811 14:29:38.225960 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37793
--builtin_ntp_servers=127.20.132.212:40179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 14:29:38.228197 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.223107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:44687 (local address 127.20.132.254:37793)
0811 14:29:38.223178 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.223181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.223456 (+ 275us) server_negotiation.cc:407] Connection header received
0811 14:29:38.223941 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.223942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.223952 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.224003 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:38.224817 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.225472 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.226580 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.226794 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.226892 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.227875 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:38.227877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:38.227877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:38.227881 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:38.227896 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:38.227900 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:38.227939 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.228057 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.228078 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:29:38.228438 9745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.223108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37793 (local address 127.20.132.194:44687)
0811 14:29:38.223331 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.223366 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.223847 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.224063 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.224066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.224074 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:38.224672 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.224678 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.225578 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.225579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.226488 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.226491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.226901 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.226902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.227065 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.227694 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:38.227695 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:38.227744 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:38.227774 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:38.227961 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:38.227967 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:38.227970 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.228045 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.228192 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":100,"threads_started":1}
I20260811 14:29:38.228938 9743 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37793
I20260811 14:29:38.229028 9743 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:38.229225 9743 heartbeater.cc:511] Master 127.20.132.254:37793 requested a full tablet report, sending...
I20260811 14:29:38.229571 9390 ts_manager.cc:194] Registered new tserver with Master: 58cd2a6d1d1a45d19abff76b0de4f50e (127.20.132.194:37893)
I20260811 14:29:38.229923 9390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.194:44687
W20260811 14:29:38.310164 9746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:38.310405 9746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:38.310449 9746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:38.311579 9746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:38.311645 9746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:38.311689 9746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:38.313129 9746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:40179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:38.313414 9746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:38.313719 9746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:38.318782 9757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:38.318819 9753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:38.318814 9754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:38.318966 9746 server_base.cc:1034] running on GCE node
I20260811 14:29:38.319208 9746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:38.319458 9746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:38.320626 9746 hybrid_clock.cc:648] HybridClock initialized: now 1786458578320614 us; error 40 us; skew 500 ppm
I20260811 14:29:38.322086 9746 webserver.cc:460] Webserver started at http://127.20.132.195:35633/ using document root <none> and password file <none>
I20260811 14:29:38.322350 9746 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:38.322423 9746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:38.322582 9746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:38.323645 9746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "e7bc17d2c34042a1869faf9ad3bd4270"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "bdb57d63d208e0db111d09cfa6ecb474"
server_key_iv: "f9a1424ad3474c5cdb18df97929eff3a"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.324011 9746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "e7bc17d2c34042a1869faf9ad3bd4270"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "bdb57d63d208e0db111d09cfa6ecb474"
server_key_iv: "f9a1424ad3474c5cdb18df97929eff3a"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.325344 9746 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:38.326038 9764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.326205 9746 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:29:38.326303 9746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "e7bc17d2c34042a1869faf9ad3bd4270"
format_stamp: "Formatted at 2026-08-11 14:29:38 on dist-test-slave-cbbz"
server_key: "bdb57d63d208e0db111d09cfa6ecb474"
server_key_iv: "f9a1424ad3474c5cdb18df97929eff3a"
server_key_version: "encryptionkey@0"
I20260811 14:29:38.326381 9746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:38.359368 9746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:38.359727 9746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:38.359899 9746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:38.360186 9746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:38.360538 9746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:38.360602 9746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.360651 9746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:38.360682 9746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:38.367035 9746 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:41311
I20260811 14:29:38.367122 9895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:41311 every 8 connection(s)
I20260811 14:29:38.367471 9746 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:29:38.372342 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9746
I20260811 14:29:38.372478 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:29:38.372709 21011 external_mini_cluster.cc:1428] Setting key 979f5749f822caf13b3723e58cc69e5e
I20260811 14:29:38.372715 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.368234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:46173 (local address 127.20.132.254:37793)
0811 14:29:38.368315 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.368319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.368611 (+ 292us) server_negotiation.cc:407] Connection header received
0811 14:29:38.369087 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.369088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.369098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.369152 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:38.369784 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.370281 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.371212 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.371394 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.371449 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.372370 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:38.372371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:38.372371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:38.372375 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:38.372386 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:38.372389 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:38.372466 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.372627 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.372649 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:29:38.372957 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.368289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37793 (local address 127.20.132.195:46173)
0811 14:29:38.368481 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.368516 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.369003 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.369202 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.369205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.369213 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:38.369712 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.369717 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.370361 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.370362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.371127 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.371129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.371474 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.371475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.371593 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.372207 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:38.372208 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:38.372248 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:38.372279 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:38.372483 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:38.372489 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:38.372493 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.372616 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.372729 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":102,"threads_started":1}
I20260811 14:29:38.373418 9896 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37793
I20260811 14:29:38.373510 9896 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:38.373701 9896 heartbeater.cc:511] Master 127.20.132.254:37793 requested a full tablet report, sending...
I20260811 14:29:38.374078 9390 ts_manager.cc:194] Registered new tserver with Master: e7bc17d2c34042a1869faf9ad3bd4270 (127.20.132.195:41311)
I20260811 14:29:38.374540 9390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.195:46173
I20260811 14:29:38.384756 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:29:38.389256 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.386278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44298 (local address 127.20.132.254:37793)
0811 14:29:38.386322 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.386324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.386441 (+ 117us) server_negotiation.cc:407] Connection header received
0811 14:29:38.386489 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.386491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.386505 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.386553 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:38.386727 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.387191 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.387920 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.388094 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.388196 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.388930 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:38.388931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:38.388931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:38.388935 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:38.388946 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:38.388949 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:38.389012 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.389129 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.389158 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:29:38.391072 9390 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:29:38.392755 9390 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:29:38.399662 9909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.395253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.20.132.194:37893)
0811 14:29:38.395455 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.395459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.395645 (+ 186us) server_negotiation.cc:407] Connection header received
0811 14:29:38.395694 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.395696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.395730 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.395809 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:38.396082 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.397265 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.398439 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.399185 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.399274 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.399365 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.399517 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.399565 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":85,"threads_started":1}
I20260811 14:29:38.399731 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.395058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:41311 (local address 127.0.0.1:43532)
0811 14:29:38.395443 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.395488 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.395576 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.395985 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.395986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.395988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:38.396028 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.396029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.397049 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.397050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.398429 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.398431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.399407 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.399408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.399484 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.399489 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.399545 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.399585 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":77,"threads_started":1}
I20260811 14:29:38.399813 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.395179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43532 (local address 127.20.132.195:41311)
0811 14:29:38.395704 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.395708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.395717 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:29:38.395755 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.395757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.395772 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.395833 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:38.396118 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.396943 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.398508 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.399198 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.399274 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.399365 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.399665 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.399725 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":133,"threads_started":1}
I20260811 14:29:38.399684 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.395079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37893 (local address 127.0.0.1:37660)
0811 14:29:38.395443 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.395488 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.395565 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.395892 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.395895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.395897 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:38.395988 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.395990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.397359 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.397361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.398337 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.398340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.399296 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.399298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.399393 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.399408 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.399489 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.399563 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":46,"thread_start_us":103,"threads_started":1}
I20260811 14:29:38.400416 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.395298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38921 (local address 127.0.0.1:49716)
0811 14:29:38.395510 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.395519 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.395565 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.395892 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.395898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.395901 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:38.395975 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.395977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.397343 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.397344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.398619 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.398621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.399528 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.399529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.399585 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.399588 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.399644 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.399680 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":28,"thread_start_us":81,"threads_started":1}
I20260811 14:29:38.400436 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.395433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49716 (local address 127.20.132.193:38921)
0811 14:29:38.395650 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.395655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.395665 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:29:38.395713 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.395716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.395733 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.395820 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:38.396049 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.397246 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.398715 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.399319 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.399397 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.399490 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.400303 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.400353 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":94,"threads_started":1}
I20260811 14:29:38.400563 9819 tablet_service.cc:1467] Processing CreateTablet for tablet d1bd5c0b4fc4418b842c2951eae6d4a4 (DEFAULT_TABLE table=test-table [id=79973ad7a0b740328b811ff28ca09211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:38.400967 9819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bd5c0b4fc4418b842c2951eae6d4a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:38.403654 9524 tablet_service.cc:1467] Processing CreateTablet for tablet d1bd5c0b4fc4418b842c2951eae6d4a4 (DEFAULT_TABLE table=test-table [id=79973ad7a0b740328b811ff28ca09211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:38.403651 9672 tablet_service.cc:1467] Processing CreateTablet for tablet d1bd5c0b4fc4418b842c2951eae6d4a4 (DEFAULT_TABLE table=test-table [id=79973ad7a0b740328b811ff28ca09211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:38.403779 9912 tablet_bootstrap.cc:492] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Bootstrap starting.
I20260811 14:29:38.404011 9524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bd5c0b4fc4418b842c2951eae6d4a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:38.404011 9672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bd5c0b4fc4418b842c2951eae6d4a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:38.404561 9912 tablet_bootstrap.cc:654] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:38.404872 9912 log.cc:824] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:38.405644 9912 tablet_bootstrap.cc:492] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: No bootstrap required, opened a new log
I20260811 14:29:38.405726 9912 ts_tablet_manager.cc:1397] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:29:38.407591 9915 tablet_bootstrap.cc:492] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: Bootstrap starting.
I20260811 14:29:38.407826 9914 tablet_bootstrap.cc:492] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Bootstrap starting.
I20260811 14:29:38.407994 9912 raft_consensus.cc:348] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.408209 9912 raft_consensus.cc:374] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:38.408262 9912 raft_consensus.cc:729] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7bc17d2c34042a1869faf9ad3bd4270, State: Initialized, Role: FOLLOWER
I20260811 14:29:38.408380 9912 consensus_queue.cc:260] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.408576 9914 tablet_bootstrap.cc:654] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:38.408689 9912 ts_tablet_manager.cc:1428] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:29:38.408732 9896 heartbeater.cc:503] Master 127.20.132.254:37793 was elected leader, sending a full tablet report...
I20260811 14:29:38.408926 9914 log.cc:824] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:38.409799 9915 tablet_bootstrap.cc:654] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:38.409854 9914 tablet_bootstrap.cc:492] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: No bootstrap required, opened a new log
I20260811 14:29:38.409924 9914 ts_tablet_manager.cc:1397] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:29:38.410135 9915 log.cc:824] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:38.411053 9915 tablet_bootstrap.cc:492] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: No bootstrap required, opened a new log
I20260811 14:29:38.411118 9915 ts_tablet_manager.cc:1397] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 14:29:38.412657 9914 raft_consensus.cc:348] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.412810 9914 raft_consensus.cc:374] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:38.412846 9914 raft_consensus.cc:729] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58cd2a6d1d1a45d19abff76b0de4f50e, State: Initialized, Role: FOLLOWER
I20260811 14:29:38.412961 9914 consensus_queue.cc:260] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.413215 9914 ts_tablet_manager.cc:1428] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:29:38.413273 9743 heartbeater.cc:503] Master 127.20.132.254:37793 was elected leader, sending a full tablet report...
I20260811 14:29:38.413707 9915 raft_consensus.cc:348] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.413864 9915 raft_consensus.cc:374] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:38.413901 9915 raft_consensus.cc:729] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676c9edff04418993bde91544ab4a8a, State: Initialized, Role: FOLLOWER
I20260811 14:29:38.414017 9915 consensus_queue.cc:260] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.414275 9915 ts_tablet_manager.cc:1428] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:29:38.414328 9598 heartbeater.cc:503] Master 127.20.132.254:37793 was elected leader, sending a full tablet report...
W20260811 14:29:38.472980 9744 tablet.cc:2369] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:29:38.524704 9919 raft_consensus.cc:482] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:38.524833 9919 raft_consensus.cc:504] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.525211 9919 leader_election.cc:288] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7bc17d2c34042a1869faf9ad3bd4270 (127.20.132.195:41311), 1676c9edff04418993bde91544ab4a8a (127.20.132.193:38921)
I20260811 14:29:38.528128 9745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.525394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:41311 (local address 127.20.132.194:43535)
0811 14:29:38.525433 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.525446 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.525502 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.525690 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.525693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.525695 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:38.525781 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.525783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.526480 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.526481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.527298 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.527300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.527880 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.527881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.527957 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.527962 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.528019 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.528051 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 14:29:38.528189 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.525477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:43535 (local address 127.20.132.195:41311)
0811 14:29:38.525535 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.525537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.525548 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:29:38.525581 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.525582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.525593 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.525655 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:38.525871 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.526403 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.527402 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.527799 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.527857 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.527864 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.528039 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.528087 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 14:29:38.528281 9921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.525430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38921 (local address 127.20.132.194:33455)
0811 14:29:38.525616 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.525625 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:38.525669 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:38.525861 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:38.525862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:38.525864 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:38.525939 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.525940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.526580 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.526580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.527392 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:38.527394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.527964 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.527965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:38.528069 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.528073 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:38.528153 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:29:38.528189 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
I20260811 14:29:38.528312 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.525556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:33455 (local address 127.20.132.193:38921)
0811 14:29:38.525606 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.525609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.525669 (+ 60us) server_negotiation.cc:407] Connection header received
0811 14:29:38.525737 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.525738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.525753 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.525822 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:38.526018 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.526494 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.527488 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.527876 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.527950 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.527958 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.528179 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.528228 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:29:38.528635 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bd5c0b4fc4418b842c2951eae6d4a4" candidate_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" is_pre_election: true
I20260811 14:29:38.528775 9547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bd5c0b4fc4418b842c2951eae6d4a4" candidate_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676c9edff04418993bde91544ab4a8a" is_pre_election: true
I20260811 14:29:38.528818 9842 raft_consensus.cc:2454] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58cd2a6d1d1a45d19abff76b0de4f50e in term 0.
I20260811 14:29:38.528913 9547 raft_consensus.cc:2454] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58cd2a6d1d1a45d19abff76b0de4f50e in term 0.
I20260811 14:29:38.529088 9618 leader_election.cc:302] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58cd2a6d1d1a45d19abff76b0de4f50e, e7bc17d2c34042a1869faf9ad3bd4270; no voters:
I20260811 14:29:38.529229 9919 raft_consensus.cc:2781] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:29:38.529317 9919 raft_consensus.cc:482] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:38.529352 9919 raft_consensus.cc:3037] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:38.530220 9919 raft_consensus.cc:504] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.530418 9919 leader_election.cc:288] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [CANDIDATE]: Term 1 election: Requested vote from peers e7bc17d2c34042a1869faf9ad3bd4270 (127.20.132.195:41311), 1676c9edff04418993bde91544ab4a8a (127.20.132.193:38921)
I20260811 14:29:38.530573 9547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bd5c0b4fc4418b842c2951eae6d4a4" candidate_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676c9edff04418993bde91544ab4a8a"
I20260811 14:29:38.530613 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bd5c0b4fc4418b842c2951eae6d4a4" candidate_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7bc17d2c34042a1869faf9ad3bd4270"
I20260811 14:29:38.530680 9842 raft_consensus.cc:3037] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:38.530670 9547 raft_consensus.cc:3037] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:38.531665 9842 raft_consensus.cc:2454] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58cd2a6d1d1a45d19abff76b0de4f50e in term 1.
I20260811 14:29:38.531665 9547 raft_consensus.cc:2454] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58cd2a6d1d1a45d19abff76b0de4f50e in term 1.
I20260811 14:29:38.531857 9619 leader_election.cc:302] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676c9edff04418993bde91544ab4a8a, 58cd2a6d1d1a45d19abff76b0de4f50e; no voters:
I20260811 14:29:38.531965 9919 raft_consensus.cc:2781] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:38.532109 9919 raft_consensus.cc:686] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 1 LEADER]: Becoming Leader. State: Replica: 58cd2a6d1d1a45d19abff76b0de4f50e, State: Running, Role: LEADER
I20260811 14:29:38.532231 9919 consensus_queue.cc:237] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } }
I20260811 14:29:38.533095 9390 catalog_manager.cc:5495] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e reported cstate change: term changed from 0 to 1, leader changed from <none> to 58cd2a6d1d1a45d19abff76b0de4f50e (127.20.132.194). New cstate: current_term: 1 leader_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58cd2a6d1d1a45d19abff76b0de4f50e" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 } health_report { overall_health: UNKNOWN } } }
I20260811 14:29:38.543632 9909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.541420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56578 (local address 127.20.132.194:37893)
0811 14:29:38.541480 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:38.541482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:38.541491 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:29:38.541518 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:38.541519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:38.541536 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:38.541604 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:29:38.541712 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.542175 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.542917 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:38.543114 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:38.543166 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:38.543290 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:29:38.543400 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:29:38.543484 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:38.543547 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 14:29:38.543557 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 14:29:38.545637 9547 raft_consensus.cc:1261] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 1 FOLLOWER]: Refusing update from remote peer 58cd2a6d1d1a45d19abff76b0de4f50e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:38.545732 9842 raft_consensus.cc:1261] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 1 FOLLOWER]: Refusing update from remote peer 58cd2a6d1d1a45d19abff76b0de4f50e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:38.546042 9919 consensus_queue.cc:1035] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676c9edff04418993bde91544ab4a8a" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 38921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:38.546205 9922 consensus_queue.cc:1035] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7bc17d2c34042a1869faf9ad3bd4270" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 41311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:38.549790 9927 mvcc.cc:205] Tried to move back new op lower bound from 7317334337720172544 to 7317334337668546560. Current Snapshot: MvccSnapshot[applied={T|T < 7317334337720172544 or (T in {7317334337720172544})}]
I20260811 14:29:38.551496 9389 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:38.551601 9389 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:38.552378 9389 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c722d63f34042929f3daeda4fcd0f86: Sending DeleteTablet for 3 replicas of tablet d1bd5c0b4fc4418b842c2951eae6d4a4
I20260811 14:29:38.552763 9672 tablet_service.cc:1514] Processing DeleteTablet for tablet d1bd5c0b4fc4418b842c2951eae6d4a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:38 UTC) from {username='slave'} at 127.0.0.1:37660
I20260811 14:29:38.552783 9524 tablet_service.cc:1514] Processing DeleteTablet for tablet d1bd5c0b4fc4418b842c2951eae6d4a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:38 UTC) from {username='slave'} at 127.0.0.1:49716
I20260811 14:29:38.552775 9819 tablet_service.cc:1514] Processing DeleteTablet for tablet d1bd5c0b4fc4418b842c2951eae6d4a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:38 UTC) from {username='slave'} at 127.0.0.1:43532
I20260811 14:29:38.552996 9937 tablet_replica.cc:330] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: stopping tablet replica
I20260811 14:29:38.553197 9939 tablet_replica.cc:330] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a: stopping tablet replica
I20260811 14:29:38.553306 9939 raft_consensus.cc:2229] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:38.553385 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9455
I20260811 14:29:38.553418 9939 raft_consensus.cc:2258] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 1676c9edff04418993bde91544ab4a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:38.553574 9938 tablet_replica.cc:330] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: stopping tablet replica
I20260811 14:29:38.553661 9938 raft_consensus.cc:2229] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:38.553747 9938 raft_consensus.cc:2258] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:38.554188 9938 ts_tablet_manager.cc:1905] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:38.555693 9938 ts_tablet_manager.cc:1918] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:38.555778 9938 log.cc:1196] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/d1bd5c0b4fc4418b842c2951eae6d4a4
I20260811 14:29:38.556087 9938 ts_tablet_manager.cc:1939] T d1bd5c0b4fc4418b842c2951eae6d4a4 P e7bc17d2c34042a1869faf9ad3bd4270: Deleting consensus metadata
I20260811 14:29:38.556497 9372 catalog_manager.cc:4841] TS e7bc17d2c34042a1869faf9ad3bd4270 (127.20.132.195:41311): tablet d1bd5c0b4fc4418b842c2951eae6d4a4 (table test-table [id=79973ad7a0b740328b811ff28ca09211]) successfully deleted
I20260811 14:29:38.564461 9937 raft_consensus.cc:2229] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:29:38.564683 9937 raft_consensus.cc:2258] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:38.565375 9937 ts_tablet_manager.cc:1905] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:38.567622 9937 ts_tablet_manager.cc:1918] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:38.567710 9937 log.cc:1196] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/d1bd5c0b4fc4418b842c2951eae6d4a4
I20260811 14:29:38.567970 9937 ts_tablet_manager.cc:1939] T d1bd5c0b4fc4418b842c2951eae6d4a4 P 58cd2a6d1d1a45d19abff76b0de4f50e: Deleting consensus metadata
I20260811 14:29:38.568488 9374 catalog_manager.cc:4841] TS 58cd2a6d1d1a45d19abff76b0de4f50e (127.20.132.194:37893): tablet d1bd5c0b4fc4418b842c2951eae6d4a4 (table test-table [id=79973ad7a0b740328b811ff28ca09211]) successfully deleted
W20260811 14:29:38.570926 9374 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:38921 (error 108)
I20260811 14:29:38.571153 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9601
I20260811 14:29:38.572078 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:38.571269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:38921 (local address 127.0.0.1:40786)
0811 14:29:38.571973 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:38.572033 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:38921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":678}
W20260811 14:29:38.572261 9374 catalog_manager.cc:4584] TS 1676c9edff04418993bde91544ab4a8a (127.20.132.193:38921): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d1bd5c0b4fc4418b842c2951eae6d4a4: Network error: Client connection negotiation failed: client connection to 127.20.132.193:38921: connect: Connection refused (error 111)
I20260811 14:29:38.577693 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9746
I20260811 14:29:38.583281 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9356
2026-08-11T14:29:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (803 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:38 dist-test-slave-cbbz krb5kdc[9944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:38 dist-test-slave-cbbz krb5kdc[9944](info): set up 2 sockets
Aug 11 14:29:38 dist-test-slave-cbbz krb5kdc[9944](info): commencing operation
krb5kdc: starting...
W20260811 14:29:39.674721 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:39 dist-test-slave-cbbz krb5kdc[9944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:29:39.794325 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:35705
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:35705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:39.874208 9958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:39.874465 9958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:39.874505 9958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:39.875662 9958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:39.875739 9958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:39.875765 9958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:39.875793 9958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:39.875823 9958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:39.877326 9958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:35705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:35705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:39.877609 9958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:39.877838 9958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:39.882745 9963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:39.882840 9965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:39.882755 9967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:39.883015 9958 server_base.cc:1034] running on GCE node
I20260811 14:29:39.883358 9958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:39.883697 9958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:39.884851 9958 hybrid_clock.cc:648] HybridClock initialized: now 1786458579884831 us; error 44 us; skew 500 ppm
Aug 11 14:29:39 dist-test-slave-cbbz krb5kdc[9944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458579, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:39.887436 9958 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:29:39.887868 9958 webserver.cc:460] Webserver started at http://127.20.132.254:44145/ using document root <none> and password file <none>
I20260811 14:29:39.888126 9958 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:39.888230 9958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:39.888388 9958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:39.889441 9958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "5f803c92acfa49abb924b2f91f84a105"
format_stamp: "Formatted at 2026-08-11 14:29:39 on dist-test-slave-cbbz"
server_key: "658beb11f8e45ddbd237dc2d5855002b"
server_key_iv: "bdee5b00a0d343abe463a28d25b70e21"
server_key_version: "encryptionkey@0"
I20260811 14:29:39.889818 9958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "5f803c92acfa49abb924b2f91f84a105"
format_stamp: "Formatted at 2026-08-11 14:29:39 on dist-test-slave-cbbz"
server_key: "658beb11f8e45ddbd237dc2d5855002b"
server_key_iv: "bdee5b00a0d343abe463a28d25b70e21"
server_key_version: "encryptionkey@0"
I20260811 14:29:39.891147 9958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:39.891865 9975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:39.892045 9958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:39.892164 9958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "5f803c92acfa49abb924b2f91f84a105"
format_stamp: "Formatted at 2026-08-11 14:29:39 on dist-test-slave-cbbz"
server_key: "658beb11f8e45ddbd237dc2d5855002b"
server_key_iv: "bdee5b00a0d343abe463a28d25b70e21"
server_key_version: "encryptionkey@0"
I20260811 14:29:39.892253 9958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:39.907950 9958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:39.910380 9958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:39.910542 9958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:39.914669 9958 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:35705
I20260811 14:29:39.914726 10030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:35705 every 8 connection(s)
I20260811 14:29:39.915091 9958 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:39.916024 10031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:39.918339 10031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105: Bootstrap starting.
I20260811 14:29:39.918696 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 9958
I20260811 14:29:39.918826 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:39.919018 10031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:39.919064 21011 external_mini_cluster.cc:1428] Setting key 4fa1c13bd2ce77f1f81df607727f2a01
I20260811 14:29:39.919314 10031 log.cc:824] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:39.920118 10031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105: No bootstrap required, opened a new log
I20260811 14:29:39.922556 10031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f803c92acfa49abb924b2f91f84a105" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35705 } }
I20260811 14:29:39.922735 10031 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:39.922768 10031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f803c92acfa49abb924b2f91f84a105, State: Initialized, Role: FOLLOWER
I20260811 14:29:39.922886 10031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f803c92acfa49abb924b2f91f84a105" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35705 } }
I20260811 14:29:39.923000 10031 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:39.923045 10031 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:39.923097 10031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:39.923704 10031 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f803c92acfa49abb924b2f91f84a105" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35705 } }
I20260811 14:29:39.923810 10031 leader_election.cc:302] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f803c92acfa49abb924b2f91f84a105; no voters:
I20260811 14:29:39.923972 10031 leader_election.cc:288] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:39.924036 10037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:39.924232 10037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [term 1 LEADER]: Becoming Leader. State: Replica: 5f803c92acfa49abb924b2f91f84a105, State: Running, Role: LEADER
I20260811 14:29:39.924237 10031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:39.924336 10037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f803c92acfa49abb924b2f91f84a105" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35705 } }
I20260811 14:29:39.924685 10038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f803c92acfa49abb924b2f91f84a105" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f803c92acfa49abb924b2f91f84a105" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35705 } } }
I20260811 14:29:39.924662 10037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f803c92acfa49abb924b2f91f84a105. Latest consensus state: current_term: 1 leader_uuid: "5f803c92acfa49abb924b2f91f84a105" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f803c92acfa49abb924b2f91f84a105" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 35705 } } }
I20260811 14:29:39.924847 10037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:39.924836 10038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:39.925478 10047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:39.925972 10047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 14:29:39 dist-test-slave-cbbz krb5kdc[9944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:39.927688 10047 catalog_manager.cc:1347] Generated new cluster ID: 4c0b713cb6b946f38e44a610b69bac76
I20260811 14:29:39.927758 10047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:39.931020 10036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:39.919614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58790 (local address 127.20.132.254:35705)
0811 14:29:39.919795 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:39.919804 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:39.919838 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:29:39.920471 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:39.920481 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:39.920542 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:39.920688 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:39.921325 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:39.922791 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:39.923678 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:39.924368 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:39.926446 (+ 2078us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:39.927527 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:39.927531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:39.927532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:39.927544 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:39.929402 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:39.929801 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:39.929804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:39.929804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:39.929899 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:39.930136 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:39.930137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:39.930138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:39.930377 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:39.930540 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:39.930660 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 14:29:39.930796 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260811 14:29:39.935158 10047 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:39.935696 10047 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:39.941884 10047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105: Generated new TSK 0
I20260811 14:29:39.942046 10047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.132.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
Entry for principal kudu/127.20.132.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab.
I20260811 14:29:39.975253 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35705
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:40.059376 10060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:40.059659 10060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:40.059689 10060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:40.060886 10060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:40.060925 10060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:40.060949 10060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:40.062325 10060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.193.keytab
--principal=kudu/127.20.132.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:40.062515 10060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:40.062698 10060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:40.067667 10072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.067643 10069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.067660 10060 server_base.cc:1034] running on GCE node
W20260811 14:29:40.067633 10068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.068094 10060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:40.068367 10060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:40.069558 10060 hybrid_clock.cc:648] HybridClock initialized: now 1786458580069541 us; error 30 us; skew 500 ppm
Aug 11 14:29:40 dist-test-slave-cbbz krb5kdc[9944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458580, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:40.072273 10060 init.cc:377] Logged in from keytab as kudu/127.20.132.193@KRBTEST.COM (short username kudu)
I20260811 14:29:40.072659 10060 webserver.cc:460] Webserver started at http://127.20.132.193:44183/ using document root <none> and password file <none>
I20260811 14:29:40.072881 10060 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:40.072921 10060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:40.073004 10060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:40.073974 10060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "86ba18583ebd5d62cb4ec1d57a299d99"
server_key_iv: "b44b74d3622944acedf462b652a14c9b"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.074282 10060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "86ba18583ebd5d62cb4ec1d57a299d99"
server_key_iv: "b44b74d3622944acedf462b652a14c9b"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.075505 10060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:29:40.076231 10080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.076385 10060 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:40.076471 10060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "86ba18583ebd5d62cb4ec1d57a299d99"
server_key_iv: "b44b74d3622944acedf462b652a14c9b"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.076527 10060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:40.084857 10060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:40.086632 10060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:40.086745 10060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:40.086917 10060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:40.087215 10060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:40.087249 10060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.087271 10060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:40.087316 10060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.093109 10060 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:33353
I20260811 14:29:40.093206 10206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:33353 every 8 connection(s)
I20260811 14:29:40.093508 10060 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
Aug 11 14:29:40 dist-test-slave-cbbz krb5kdc[9944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458580, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.193@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:40.100298 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10060
I20260811 14:29:40.100442 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:29:40.100694 21011 external_mini_cluster.cc:1428] Setting key ac90327214977748e164ebff5003b7b3
I20260811 14:29:40.103544 10036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.094224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:41059 (local address 127.20.132.254:35705)
0811 14:29:40.094287 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.094289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.094508 (+ 219us) server_negotiation.cc:407] Connection header received
0811 14:29:40.095137 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.095138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.095152 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.095209 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.096246 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.096745 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.097694 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.097913 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.097962 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.100106 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.100108 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.100108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:40.100116 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.102168 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.102565 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.102566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.102566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.102636 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.102870 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.102871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.102871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.103020 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.103088 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.103341 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.103449 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:29:40.103770 10209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.094206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35705 (local address 127.20.132.193:41059)
0811 14:29:40.094360 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.094415 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.095014 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.095279 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.095282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.095852 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:40.096080 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.096085 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.096824 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.096824 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.097620 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.097622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.097982 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.097983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.098075 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.098600 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:40.098608 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:40.099988 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:40.102259 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:40.102266 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:40.102267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:40.102492 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:40.102709 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:40.102710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:40.102710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:40.102804 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:40.103083 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:40.103087 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:40.103193 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.103311 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.103467 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
I20260811 14:29:40.104233 10207 heartbeater.cc:347] Connected to a master server at 127.20.132.254:35705
I20260811 14:29:40.104341 10207 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:40.104538 10207 heartbeater.cc:511] Master 127.20.132.254:35705 requested a full tablet report, sending...
I20260811 14:29:40.105101 9993 ts_manager.cc:194] Registered new tserver with Master: ec4b8ff88e5e4a97b3d41d4a1aa92d30 (127.20.132.193:33353)
I20260811 14:29:40.105751 9993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.193@KRBTEST.COM'} at 127.20.132.193:41059
WARNING: no policy specified for kudu/127.20.132.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
Entry for principal kudu/127.20.132.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab.
I20260811 14:29:40.127677 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35705
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:40.210345 10212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:40.210585 10212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:40.210623 10212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:40.211766 10212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:40.211830 10212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:40.211875 10212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:40.213374 10212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.194.keytab
--principal=kudu/127.20.132.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:40.213642 10212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:40.213872 10212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:40.219097 10217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.219110 10218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.219102 10212 server_base.cc:1034] running on GCE node
W20260811 14:29:40.219168 10220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.219640 10212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:40.219899 10212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:40.221061 10212 hybrid_clock.cc:648] HybridClock initialized: now 1786458580221040 us; error 66 us; skew 500 ppm
Aug 11 14:29:40 dist-test-slave-cbbz krb5kdc[9944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458580, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:40.223644 10212 init.cc:377] Logged in from keytab as kudu/127.20.132.194@KRBTEST.COM (short username kudu)
I20260811 14:29:40.224109 10212 webserver.cc:460] Webserver started at http://127.20.132.194:39603/ using document root <none> and password file <none>
I20260811 14:29:40.224372 10212 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:40.224444 10212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:40.224602 10212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:40.225849 10212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "709fbe4408a241ef9d5f36dbcd36a9cc"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "a9534b1c1d2509179416bcb0591b3c13"
server_key_iv: "07e23ddaf44ff1753be206b42a87b730"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.226257 10212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "709fbe4408a241ef9d5f36dbcd36a9cc"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "a9534b1c1d2509179416bcb0591b3c13"
server_key_iv: "07e23ddaf44ff1753be206b42a87b730"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.227604 10212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:40.228404 10227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.228588 10212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:40.228693 10212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "709fbe4408a241ef9d5f36dbcd36a9cc"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "a9534b1c1d2509179416bcb0591b3c13"
server_key_iv: "07e23ddaf44ff1753be206b42a87b730"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.228775 10212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:40.237006 10212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:40.238787 10212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:40.238950 10212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:40.239174 10212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:40.239488 10212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:40.239543 10212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.239584 10212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:40.239611 10212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.245652 10212 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:45377
I20260811 14:29:40.245729 10352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:45377 every 8 connection(s)
I20260811 14:29:40.246044 10212 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
Aug 11 14:29:40 dist-test-slave-cbbz krb5kdc[9944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458580, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.194@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:40.252733 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10212
I20260811 14:29:40.252862 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:29:40.253088 21011 external_mini_cluster.cc:1428] Setting key 83796136370f233dbe3c969a73311639
I20260811 14:29:40.255455 10036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.246769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:57631 (local address 127.20.132.254:35705)
0811 14:29:40.246837 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.246839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.247044 (+ 205us) server_negotiation.cc:407] Connection header received
0811 14:29:40.247540 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.247542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.247551 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.247618 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.248620 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.249119 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.250063 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.250259 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.250316 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.252418 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.252420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.252420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:40.252426 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.254053 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.254455 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.254457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.254457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.254516 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.254798 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.254799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.254799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.254922 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.255002 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.255279 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.255366 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:29:40.255640 10357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.246728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35705 (local address 127.20.132.194:57631)
0811 14:29:40.246910 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.246950 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.247457 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.247690 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.247693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.248351 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:40.248538 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.248543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.249209 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.249210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.249983 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.249985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.250337 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.250338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.250438 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.250901 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:40.250909 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:40.252330 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:40.254141 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:40.254149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:40.254151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:40.254374 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:40.254609 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:40.254610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:40.254611 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:40.254727 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:40.254992 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:40.254999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:40.255141 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.255246 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.255406 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260811 14:29:40.256348 10353 heartbeater.cc:347] Connected to a master server at 127.20.132.254:35705
I20260811 14:29:40.256456 10353 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:40.256652 10353 heartbeater.cc:511] Master 127.20.132.254:35705 requested a full tablet report, sending...
I20260811 14:29:40.257061 9993 ts_manager.cc:194] Registered new tserver with Master: 709fbe4408a241ef9d5f36dbcd36a9cc (127.20.132.194:45377)
I20260811 14:29:40.257455 9993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.194@KRBTEST.COM'} at 127.20.132.194:57631
WARNING: no policy specified for kudu/127.20.132.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
Entry for principal kudu/127.20.132.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab.
I20260811 14:29:40.279418 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35705
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:34863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:40.361272 10360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:40.361482 10360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:40.361505 10360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:40.362617 10360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:40.362653 10360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:40.362679 10360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:40.364115 10360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:34863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.195.keytab
--principal=kudu/127.20.132.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:35705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:40.364323 10360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:40.364496 10360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:40.369405 10368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.369369 10365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.369604 10366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.369805 10360 server_base.cc:1034] running on GCE node
I20260811 14:29:40.370005 10360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:40.370249 10360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:40.371414 10360 hybrid_clock.cc:648] HybridClock initialized: now 1786458580371409 us; error 37 us; skew 500 ppm
Aug 11 14:29:40 dist-test-slave-cbbz krb5kdc[9944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458580, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:40.374022 10360 init.cc:377] Logged in from keytab as kudu/127.20.132.195@KRBTEST.COM (short username kudu)
I20260811 14:29:40.374516 10360 webserver.cc:460] Webserver started at http://127.20.132.195:44863/ using document root <none> and password file <none>
I20260811 14:29:40.374766 10360 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:40.374836 10360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:40.374985 10360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:40.376009 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "048a100e385d430781f9f8bc8ec0b9b9"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "186c401809bc2c64bfda0e42f6f93615"
server_key_iv: "9836729b160cb7c139a0b9f439712c0a"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.376394 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "048a100e385d430781f9f8bc8ec0b9b9"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "186c401809bc2c64bfda0e42f6f93615"
server_key_iv: "9836729b160cb7c139a0b9f439712c0a"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.377727 10360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:40.378404 10375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.378578 10360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:29:40.378683 10360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "048a100e385d430781f9f8bc8ec0b9b9"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "186c401809bc2c64bfda0e42f6f93615"
server_key_iv: "9836729b160cb7c139a0b9f439712c0a"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.378769 10360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:40.409017 10360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:40.411464 10360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:40.411638 10360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:40.411885 10360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:40.412266 10360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:40.412304 10360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.412326 10360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:40.412370 10360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.418465 10360 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:45357
I20260811 14:29:40.418514 10500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:45357 every 8 connection(s)
I20260811 14:29:40.418828 10360 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:29:40.424925 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10360
Aug 11 14:29:40 dist-test-slave-cbbz krb5kdc[9944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458580, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.195@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:40.425048 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:29:40.425328 21011 external_mini_cluster.cc:1428] Setting key 32466a322396064e95f02468dcd31c3f
I20260811 14:29:40.428287 10036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.419602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:45437 (local address 127.20.132.254:35705)
0811 14:29:40.419668 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.419670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.419918 (+ 248us) server_negotiation.cc:407] Connection header received
0811 14:29:40.420471 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.420472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.420483 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.420537 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.421449 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.421956 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.422900 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.423098 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.423155 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.425640 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.425641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.425642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:40.425649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.427112 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.427480 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.427481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.427481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.427531 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.427717 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.427717 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.427717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.427815 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.427866 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.428086 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.428199 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:29:40.428561 10503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.419604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:35705 (local address 127.20.132.195:45437)
0811 14:29:40.419770 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.419806 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.420381 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.420614 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.420618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.421163 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:40.421365 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.421369 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.422038 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.422039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.422821 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.422822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.423176 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.423177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.423282 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.423770 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:29:40.423778 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:40.425521 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:40.427188 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:40.427195 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:40.427196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:40.427412 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:40.427572 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:29:40.427572 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:29:40.427573 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:29:40.427664 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:29:40.427873 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:40.427878 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:40.427985 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.428067 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.428254 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
I20260811 14:29:40.429072 10501 heartbeater.cc:347] Connected to a master server at 127.20.132.254:35705
I20260811 14:29:40.429188 10501 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:40.429324 10501 heartbeater.cc:511] Master 127.20.132.254:35705 requested a full tablet report, sending...
I20260811 14:29:40.429654 9993 ts_manager.cc:194] Registered new tserver with Master: 048a100e385d430781f9f8bc8ec0b9b9 (127.20.132.195:45357)
I20260811 14:29:40.430040 9993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.132.195@KRBTEST.COM'} at 127.20.132.195:45437
I20260811 14:29:40.437398 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:29:40.444983 10036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.438777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58794 (local address 127.20.132.254:35705)
0811 14:29:40.438852 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.438854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.438902 (+ 48us) server_negotiation.cc:407] Connection header received
0811 14:29:40.438968 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.438969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.438977 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.439025 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.439629 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.440125 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.440904 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.441115 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.441191 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.442405 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.442406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.442407 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:40.442414 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.443691 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.444094 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.444095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.444095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.444213 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:40.444409 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:40.444411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:40.444411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:40.444572 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.444685 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.444791 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.444878 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 14:29:40.446455 9993 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:29:40.447974 9993 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:29:40.454628 10513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.450283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:33353 (local address 127.0.0.1:53694)
0811 14:29:40.450592 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.450640 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.450725 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.451102 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.451104 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.451106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:40.451173 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.451176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.452114 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.452115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.453302 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.453305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.454309 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.454310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.454389 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.454401 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.454480 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.454535 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":2,"thread_start_us":106,"threads_started":1}
I20260811 14:29:40.454818 10514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.450284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:45377 (local address 127.0.0.1:46348)
0811 14:29:40.450697 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.450721 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.450819 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.451083 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.451087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.451089 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:40.451167 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.451169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.452622 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.452623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.453726 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.453729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.454612 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.454613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.454674 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.454678 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.454709 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.454755 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":29,"thread_start_us":48,"threads_started":1}
I20260811 14:29:40.454674 10515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.450401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53694 (local address 127.20.132.193:33353)
0811 14:29:40.450848 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.450852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.450863 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:29:40.450906 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.450908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.450928 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.451009 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:40.451273 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.452008 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.453404 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.454146 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.454216 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.454270 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.454517 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.454567 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":85,"threads_started":1}
I20260811 14:29:40.454993 10517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.450490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:45357 (local address 127.0.0.1:52606)
0811 14:29:40.450914 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.450923 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.450967 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.451247 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.451247 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.451249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:40.451281 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.451282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.452625 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.452626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.453822 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.453825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.454768 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.454769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.454822 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.454825 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.454881 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.454922 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":31,"thread_start_us":81,"threads_started":1}
I20260811 14:29:40.455217 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.450436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46348 (local address 127.20.132.194:45377)
0811 14:29:40.450633 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.450639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.450785 (+ 146us) server_negotiation.cc:407] Connection header received
0811 14:29:40.450911 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.450914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.450961 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.451252 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:40.451353 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.452493 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.453817 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.454521 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.454985 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.455052 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.455079 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.455127 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":74,"threads_started":1}
I20260811 14:29:40.455212 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.450598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52606 (local address 127.20.132.195:45357)
0811 14:29:40.450808 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.450812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.451028 (+ 216us) server_negotiation.cc:407] Connection header received
0811 14:29:40.451072 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.451074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.451091 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.451162 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:40.451362 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.452515 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.453938 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.454569 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.454640 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.454808 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.454945 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.454985 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":105,"threads_started":1}
I20260811 14:29:40.455818 10132 tablet_service.cc:1467] Processing CreateTablet for tablet 20777f48c4ce49b89bbcabe0fd27d63c (DEFAULT_TABLE table=test-table [id=65a9ef034068469db3163a96bad230c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:40.455890 10429 tablet_service.cc:1467] Processing CreateTablet for tablet 20777f48c4ce49b89bbcabe0fd27d63c (DEFAULT_TABLE table=test-table [id=65a9ef034068469db3163a96bad230c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:40.455924 10282 tablet_service.cc:1467] Processing CreateTablet for tablet 20777f48c4ce49b89bbcabe0fd27d63c (DEFAULT_TABLE table=test-table [id=65a9ef034068469db3163a96bad230c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:40.456235 10132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20777f48c4ce49b89bbcabe0fd27d63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:40.456257 10282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20777f48c4ce49b89bbcabe0fd27d63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:40.456264 10429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20777f48c4ce49b89bbcabe0fd27d63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:40.458767 10519 tablet_bootstrap.cc:492] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: Bootstrap starting.
I20260811 14:29:40.459549 10519 tablet_bootstrap.cc:654] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:40.459528 10521 tablet_bootstrap.cc:492] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Bootstrap starting.
I20260811 14:29:40.459853 10522 tablet_bootstrap.cc:492] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Bootstrap starting.
I20260811 14:29:40.460258 10521 tablet_bootstrap.cc:654] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:40.460291 10519 log.cc:824] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:40.460515 10522 tablet_bootstrap.cc:654] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:40.460844 10521 log.cc:824] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:40.461191 10519 tablet_bootstrap.cc:492] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: No bootstrap required, opened a new log
I20260811 14:29:40.461184 10522 log.cc:824] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:40.461280 10519 ts_tablet_manager.cc:1397] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:29:40.461583 10521 tablet_bootstrap.cc:492] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: No bootstrap required, opened a new log
I20260811 14:29:40.461673 10521 ts_tablet_manager.cc:1397] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:29:40.461966 10522 tablet_bootstrap.cc:492] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: No bootstrap required, opened a new log
I20260811 14:29:40.462033 10522 ts_tablet_manager.cc:1397] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:29:40.463095 10519 raft_consensus.cc:348] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.463260 10519 raft_consensus.cc:374] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:40.463306 10519 raft_consensus.cc:729] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4b8ff88e5e4a97b3d41d4a1aa92d30, State: Initialized, Role: FOLLOWER
I20260811 14:29:40.463419 10519 consensus_queue.cc:260] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.463721 10519 ts_tablet_manager.cc:1428] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:29:40.463635 10521 raft_consensus.cc:348] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.463794 10521 raft_consensus.cc:374] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:40.463837 10521 raft_consensus.cc:729] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 709fbe4408a241ef9d5f36dbcd36a9cc, State: Initialized, Role: FOLLOWER
I20260811 14:29:40.463858 10207 heartbeater.cc:503] Master 127.20.132.254:35705 was elected leader, sending a full tablet report...
I20260811 14:29:40.463970 10521 consensus_queue.cc:260] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.463922 10522 raft_consensus.cc:348] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.464205 10522 raft_consensus.cc:374] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:40.464277 10521 ts_tablet_manager.cc:1428] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:29:40.464275 10522 raft_consensus.cc:729] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 048a100e385d430781f9f8bc8ec0b9b9, State: Initialized, Role: FOLLOWER
I20260811 14:29:40.464381 10353 heartbeater.cc:503] Master 127.20.132.254:35705 was elected leader, sending a full tablet report...
I20260811 14:29:40.464404 10522 consensus_queue.cc:260] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.464700 10522 ts_tablet_manager.cc:1428] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 14:29:40.464825 10501 heartbeater.cc:503] Master 127.20.132.254:35705 was elected leader, sending a full tablet report...
I20260811 14:29:40.467674 10526 raft_consensus.cc:482] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:40.467738 10526 raft_consensus.cc:504] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.467958 10526 leader_election.cc:288] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 709fbe4408a241ef9d5f36dbcd36a9cc (127.20.132.194:45377), 048a100e385d430781f9f8bc8ec0b9b9 (127.20.132.195:45357)
I20260811 14:29:40.470999 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.468226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:51517 (local address 127.20.132.194:45377)
0811 14:29:40.468263 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.468265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.468274 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:29:40.468325 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.468326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.468336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.468396 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:40.468591 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.469024 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.470279 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.470642 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.470723 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.470731 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.470910 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.470944 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:29:40.471000 10209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.468123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:45377 (local address 127.20.132.193:51517)
0811 14:29:40.468219 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.468231 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.468270 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.468446 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.468447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.468448 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:40.468531 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.468532 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.469088 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.469088 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.470188 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.470191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.470731 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.470733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.470824 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.470827 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.470901 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.470937 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 14:29:40.471328 10305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20777f48c4ce49b89bbcabe0fd27d63c" candidate_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" is_pre_election: true
I20260811 14:29:40.471455 10305 raft_consensus.cc:2454] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4b8ff88e5e4a97b3d41d4a1aa92d30 in term 0.
I20260811 14:29:40.471577 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.468287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:45357 (local address 127.20.132.193:52181)
0811 14:29:40.468413 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.468422 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.468468 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.469104 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.469105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.469107 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:40.469162 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.469163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.469982 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.469983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.470670 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.470672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.471318 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.471320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.471390 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.471395 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.471455 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.471495 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":86,"threads_started":1}
I20260811 14:29:40.471572 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.468330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:52181 (local address 127.20.132.195:45357)
0811 14:29:40.468364 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.468366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.468479 (+ 113us) server_negotiation.cc:407] Connection header received
0811 14:29:40.468522 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.468523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.468532 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.468587 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:40.469227 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.469900 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.470765 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.471235 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.471308 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.471315 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.471471 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.471513 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:29:40.471665 10083 leader_election.cc:302] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 709fbe4408a241ef9d5f36dbcd36a9cc, ec4b8ff88e5e4a97b3d41d4a1aa92d30; no voters:
I20260811 14:29:40.471787 10526 raft_consensus.cc:2781] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:29:40.471856 10526 raft_consensus.cc:482] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:40.471971 10450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20777f48c4ce49b89bbcabe0fd27d63c" candidate_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "048a100e385d430781f9f8bc8ec0b9b9" is_pre_election: true
I20260811 14:29:40.472055 10450 raft_consensus.cc:2454] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4b8ff88e5e4a97b3d41d4a1aa92d30 in term 0.
I20260811 14:29:40.471882 10526 raft_consensus.cc:3037] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:40.472841 10526 raft_consensus.cc:504] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.472966 10526 leader_election.cc:288] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [CANDIDATE]: Term 1 election: Requested vote from peers 709fbe4408a241ef9d5f36dbcd36a9cc (127.20.132.194:45377), 048a100e385d430781f9f8bc8ec0b9b9 (127.20.132.195:45357)
I20260811 14:29:40.473165 10450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20777f48c4ce49b89bbcabe0fd27d63c" candidate_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "048a100e385d430781f9f8bc8ec0b9b9"
I20260811 14:29:40.473153 10305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20777f48c4ce49b89bbcabe0fd27d63c" candidate_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc"
I20260811 14:29:40.473232 10450 raft_consensus.cc:3037] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:40.473255 10305 raft_consensus.cc:3037] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:40.473811 10450 raft_consensus.cc:2454] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4b8ff88e5e4a97b3d41d4a1aa92d30 in term 1.
I20260811 14:29:40.473973 10083 leader_election.cc:302] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 048a100e385d430781f9f8bc8ec0b9b9, ec4b8ff88e5e4a97b3d41d4a1aa92d30; no voters:
I20260811 14:29:40.473985 10305 raft_consensus.cc:2454] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4b8ff88e5e4a97b3d41d4a1aa92d30 in term 1.
I20260811 14:29:40.474084 10526 raft_consensus.cc:2781] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:40.474236 10526 raft_consensus.cc:686] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 1 LEADER]: Becoming Leader. State: Replica: ec4b8ff88e5e4a97b3d41d4a1aa92d30, State: Running, Role: LEADER
I20260811 14:29:40.474334 10526 consensus_queue.cc:237] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } }
I20260811 14:29:40.475040 9992 catalog_manager.cc:5495] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4b8ff88e5e4a97b3d41d4a1aa92d30 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4b8ff88e5e4a97b3d41d4a1aa92d30" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 33353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 } health_report { overall_health: UNKNOWN } } }
I20260811 14:29:40.486423 10515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.484248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.20.132.193:33353)
0811 14:29:40.484319 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.484321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.484336 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:29:40.484377 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.484378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.484396 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.484473 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:29:40.484604 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.485098 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.485814 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.485996 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.486058 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.486168 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:29:40.486252 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:29:40.486310 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.486340 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.486357 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:29:40.488034 10450 raft_consensus.cc:1261] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 1 FOLLOWER]: Refusing update from remote peer ec4b8ff88e5e4a97b3d41d4a1aa92d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:40.488036 10305 raft_consensus.cc:1261] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 1 FOLLOWER]: Refusing update from remote peer ec4b8ff88e5e4a97b3d41d4a1aa92d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:40.488392 10526 consensus_queue.cc:1035] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "048a100e385d430781f9f8bc8ec0b9b9" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:40.488523 10531 consensus_queue.cc:1035] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "709fbe4408a241ef9d5f36dbcd36a9cc" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:40.491031 10535 mvcc.cc:205] Tried to move back new op lower bound from 7317334345676591104 to 7317334345623560192. Current Snapshot: MvccSnapshot[applied={T|T < 7317334345676591104}]
I20260811 14:29:40.491549 10537 mvcc.cc:205] Tried to move back new op lower bound from 7317334345676591104 to 7317334345623560192. Current Snapshot: MvccSnapshot[applied={T|T < 7317334345676591104}]
I20260811 14:29:40.492901 9993 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:40.492990 9993 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:40.493649 9993 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f803c92acfa49abb924b2f91f84a105: Sending DeleteTablet for 3 replicas of tablet 20777f48c4ce49b89bbcabe0fd27d63c
I20260811 14:29:40.493956 10132 tablet_service.cc:1514] Processing DeleteTablet for tablet 20777f48c4ce49b89bbcabe0fd27d63c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:40 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:53694
I20260811 14:29:40.494006 10282 tablet_service.cc:1514] Processing DeleteTablet for tablet 20777f48c4ce49b89bbcabe0fd27d63c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:40 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:46348
I20260811 14:29:40.494213 10546 tablet_replica.cc:330] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30: stopping tablet replica
I20260811 14:29:40.494318 10546 raft_consensus.cc:2229] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:29:40.494294 10429 tablet_service.cc:1514] Processing DeleteTablet for tablet 20777f48c4ce49b89bbcabe0fd27d63c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:40 UTC) from {username='kudu', principal='kudu/127.20.132.254@KRBTEST.COM'} at 127.0.0.1:52606
I20260811 14:29:40.494407 10546 raft_consensus.cc:2258] T 20777f48c4ce49b89bbcabe0fd27d63c P ec4b8ff88e5e4a97b3d41d4a1aa92d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:40.494493 10547 tablet_replica.cc:330] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: stopping tablet replica
I20260811 14:29:40.494590 10547 raft_consensus.cc:2229] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:40.494624 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10060
I20260811 14:29:40.494688 10547 raft_consensus.cc:2258] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:40.494823 10548 tablet_replica.cc:330] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: stopping tablet replica
I20260811 14:29:40.494897 10548 raft_consensus.cc:2229] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:40.495002 10548 raft_consensus.cc:2258] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:40.496801 10548 ts_tablet_manager.cc:1905] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:40.497802 10547 ts_tablet_manager.cc:1905] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:40.498741 10548 ts_tablet_manager.cc:1918] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:40.498808 10548 log.cc:1196] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/20777f48c4ce49b89bbcabe0fd27d63c
I20260811 14:29:40.499075 10548 ts_tablet_manager.cc:1939] T 20777f48c4ce49b89bbcabe0fd27d63c P 048a100e385d430781f9f8bc8ec0b9b9: Deleting consensus metadata
I20260811 14:29:40.499282 10547 ts_tablet_manager.cc:1918] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:40.499330 10547 log.cc:1196] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/20777f48c4ce49b89bbcabe0fd27d63c
I20260811 14:29:40.499559 10547 ts_tablet_manager.cc:1939] T 20777f48c4ce49b89bbcabe0fd27d63c P 709fbe4408a241ef9d5f36dbcd36a9cc: Deleting consensus metadata
I20260811 14:29:40.499637 9978 catalog_manager.cc:4841] TS 048a100e385d430781f9f8bc8ec0b9b9 (127.20.132.195:45357): tablet 20777f48c4ce49b89bbcabe0fd27d63c (table test-table [id=65a9ef034068469db3163a96bad230c2]) successfully deleted
I20260811 14:29:40.499926 9978 catalog_manager.cc:4841] TS 709fbe4408a241ef9d5f36dbcd36a9cc (127.20.132.194:45377): tablet 20777f48c4ce49b89bbcabe0fd27d63c (table test-table [id=65a9ef034068469db3163a96bad230c2]) successfully deleted
W20260811 14:29:40.501900 9976 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:33353 (error 108)
I20260811 14:29:40.502422 10517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.502286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:33353 (local address 127.0.0.1:53720)
0811 14:29:40.502346 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.502386 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:33353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 14:29:40.502516 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10212
W20260811 14:29:40.508342 9976 catalog_manager.cc:4584] TS ec4b8ff88e5e4a97b3d41d4a1aa92d30 (127.20.132.193:33353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 20777f48c4ce49b89bbcabe0fd27d63c: Network error: Client connection negotiation failed: client connection to 127.20.132.193:33353: connect: Connection refused (error 111)
I20260811 14:29:40.510452 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10360
I20260811 14:29:40.516907 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 9958
2026-08-11T14:29:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1934 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T14:29:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:40Z Disabled control of system clock
I20260811 14:29:40.547821 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37031
--webserver_interface=127.20.132.254
--webserver_port=0
--builtin_ntp_servers=127.20.132.212:36461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:37031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:40.632743 10553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:40.632979 10553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:40.633000 10553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:40.634084 10553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:40.634119 10553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:40.634131 10553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:40.634145 10553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:40.634156 10553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:40.635396 10553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:37031
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:37031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:40.635573 10553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:40.635788 10553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:40.640759 10558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.640822 10559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.640826 10561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.641307 10553 server_base.cc:1034] running on GCE node
I20260811 14:29:40.641589 10553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:40.641947 10553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:40.643121 10553 hybrid_clock.cc:648] HybridClock initialized: now 1786458580643109 us; error 30 us; skew 500 ppm
I20260811 14:29:40.644778 10553 webserver.cc:460] Webserver started at http://127.20.132.254:34801/ using document root <none> and password file <none>
I20260811 14:29:40.645059 10553 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:40.645131 10553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:40.645272 10553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:40.646745 10553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "37674e2aad71492eb1412c339ed3d78c"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "10ff58f2cb9c45ff4b808c3da7a4a717"
server_key_iv: "d1add3d3b5282dbb42f235616119b626"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.647181 10553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "37674e2aad71492eb1412c339ed3d78c"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "10ff58f2cb9c45ff4b808c3da7a4a717"
server_key_iv: "d1add3d3b5282dbb42f235616119b626"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.648902 10553 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 14:29:40.649819 10567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.649992 10553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:40.650092 10553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "37674e2aad71492eb1412c339ed3d78c"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "10ff58f2cb9c45ff4b808c3da7a4a717"
server_key_iv: "d1add3d3b5282dbb42f235616119b626"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.650163 10553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:40.670658 10553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:40.670994 10553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:40.671141 10553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:40.675271 10553 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:37031
I20260811 14:29:40.675338 10628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:37031 every 8 connection(s)
I20260811 14:29:40.675755 10553 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:40.676940 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:40.679168 10629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c: Bootstrap starting.
I20260811 14:29:40.679692 10629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:40.679931 10629 log.cc:824] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:40.680631 10629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c: No bootstrap required, opened a new log
I20260811 14:29:40.682158 10629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37674e2aad71492eb1412c339ed3d78c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37031 } }
I20260811 14:29:40.682289 10629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:40.682312 10629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37674e2aad71492eb1412c339ed3d78c, State: Initialized, Role: FOLLOWER
I20260811 14:29:40.682412 10629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37674e2aad71492eb1412c339ed3d78c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37031 } }
I20260811 14:29:40.682492 10629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:40.682524 10629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:40.682580 10629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:40.682744 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10553
I20260811 14:29:40.682852 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:40.683033 21011 external_mini_cluster.cc:1428] Setting key 3ad572d8e1b66fd561aaa6178d8e8d3d
I20260811 14:29:40.683291 10629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37674e2aad71492eb1412c339ed3d78c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37031 } }
I20260811 14:29:40.683408 10629 leader_election.cc:302] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37674e2aad71492eb1412c339ed3d78c; no voters:
I20260811 14:29:40.683580 10629 leader_election.cc:288] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:40.683825 10635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:40.683827 10629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:40.684027 10635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [term 1 LEADER]: Becoming Leader. State: Replica: 37674e2aad71492eb1412c339ed3d78c, State: Running, Role: LEADER
I20260811 14:29:40.684156 10635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37674e2aad71492eb1412c339ed3d78c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37031 } }
I20260811 14:29:40.684823 10636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37674e2aad71492eb1412c339ed3d78c. Latest consensus state: current_term: 1 leader_uuid: "37674e2aad71492eb1412c339ed3d78c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37674e2aad71492eb1412c339ed3d78c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37031 } } }
I20260811 14:29:40.684924 10636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:40.685160 10633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37674e2aad71492eb1412c339ed3d78c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37674e2aad71492eb1412c339ed3d78c" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 37031 } } }
I20260811 14:29:40.685249 10633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:40.685405 10644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:40.685847 10644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:40.687435 10644 catalog_manager.cc:1347] Generated new cluster ID: e079538e3c6047c6a25667489915d5c9
I20260811 14:29:40.687494 10644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:40.689533 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.683558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49408 (local address 127.20.132.254:37031)
0811 14:29:40.683810 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.683820 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.683864 (+ 44us) server_negotiation.cc:407] Connection header received
0811 14:29:40.683991 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.684002 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.684073 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.684246 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.684566 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.686543 (+ 1977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.687524 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.687959 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.688098 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.688872 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.688876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.688876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:40.689083 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.689116 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:40.689127 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.689202 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.689276 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.689355 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
I20260811 14:29:40.698123 10644 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:40.698866 10644 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:40.706395 10644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c: Generated new TSK 0
I20260811 14:29:40.706591 10644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:40.707948 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.193:0
--local_ip_for_outbound_sockets=127.20.132.193
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37031
--builtin_ntp_servers=127.20.132.212:36461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:40.802853 10653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:40.803041 10653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:40.803062 10653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:40.804250 10653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:40.804287 10653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:40.804312 10653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.193
I20260811 14:29:40.805639 10653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.132.193
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.193
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:40.805864 10653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:40.806167 10653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:40.811153 10659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.811173 10661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.811167 10658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.811478 10653 server_base.cc:1034] running on GCE node
I20260811 14:29:40.811694 10653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:40.811949 10653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:40.813092 10653 hybrid_clock.cc:648] HybridClock initialized: now 1786458580813068 us; error 42 us; skew 500 ppm
I20260811 14:29:40.814316 10653 webserver.cc:460] Webserver started at http://127.20.132.193:34885/ using document root <none> and password file <none>
I20260811 14:29:40.814571 10653 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:40.814617 10653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:40.814762 10653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:40.815805 10653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data/instance:
uuid: "4e25c8fc2a7f4f8693011905b36041e4"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "982efd1e5e9c1e1b8067359ba4d1e35a"
server_key_iv: "960acac759f32536482a2f58f17d39d1"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.816198 10653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance:
uuid: "4e25c8fc2a7f4f8693011905b36041e4"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "982efd1e5e9c1e1b8067359ba4d1e35a"
server_key_iv: "960acac759f32536482a2f58f17d39d1"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.817653 10653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:40.818463 10669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.818665 10653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:29:40.818764 10653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal
uuid: "4e25c8fc2a7f4f8693011905b36041e4"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "982efd1e5e9c1e1b8067359ba4d1e35a"
server_key_iv: "960acac759f32536482a2f58f17d39d1"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.818857 10653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:40.827174 10653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:40.827467 10653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:40.827616 10653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:40.827862 10653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:40.828259 10653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:40.828322 10653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.828377 10653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:40.828402 10653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.835618 10653 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.193:44877
I20260811 14:29:40.835664 10797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.193:44877 every 8 connection(s)
I20260811 14:29:40.836000 10653 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/data/info.pb
I20260811 14:29:40.840999 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.836786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:40443 (local address 127.20.132.254:37031)
0811 14:29:40.836872 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.836875 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.837143 (+ 268us) server_negotiation.cc:407] Connection header received
0811 14:29:40.837639 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.837640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.837650 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.837702 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.838318 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.838821 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.839728 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.839918 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.839983 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.840778 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.840779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.840780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:40.840784 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.840797 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:40.840801 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.840846 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.840912 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.840939 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:29:40.841245 10801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.836758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37031 (local address 127.20.132.193:40443)
0811 14:29:40.837003 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.837047 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.837559 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.837754 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.837757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.837765 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:40.838251 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.838255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.838891 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.838892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.839653 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.839655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.840004 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.840005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.840109 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.840651 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:40.840651 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:40.840678 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:40.840699 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:40.840859 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:40.840863 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:40.840865 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.840915 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.840990 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":122,"threads_started":1}
I20260811 14:29:40.841832 10798 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37031
I20260811 14:29:40.841944 10798 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:40.842137 10798 heartbeater.cc:511] Master 127.20.132.254:37031 requested a full tablet report, sending...
I20260811 14:29:40.842638 10586 ts_manager.cc:194] Registered new tserver with Master: 4e25c8fc2a7f4f8693011905b36041e4 (127.20.132.193:44877)
I20260811 14:29:40.843268 10586 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.193:40443
I20260811 14:29:40.844194 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10653
I20260811 14:29:40.844309 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-0/wal/instance
I20260811 14:29:40.844514 21011 external_mini_cluster.cc:1428] Setting key b204d73474b63431aa4d1fb18efbc970
I20260811 14:29:40.845432 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.194:0
--local_ip_for_outbound_sockets=127.20.132.194
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37031
--builtin_ntp_servers=127.20.132.212:36461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 14:29:40.928311 10802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:40.928519 10802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:40.928541 10802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:40.929719 10802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:40.929760 10802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:40.929821 10802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.194
I20260811 14:29:40.931149 10802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.132.194
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.194
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:40.931401 10802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:40.931707 10802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:40.936834 10811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.936906 10802 server_base.cc:1034] running on GCE node
W20260811 14:29:40.936872 10809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:40.937005 10807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:40.937274 10802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:40.937536 10802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:40.938727 10802 hybrid_clock.cc:648] HybridClock initialized: now 1786458580938716 us; error 35 us; skew 500 ppm
I20260811 14:29:40.940299 10802 webserver.cc:460] Webserver started at http://127.20.132.194:46689/ using document root <none> and password file <none>
I20260811 14:29:40.940585 10802 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:40.940665 10802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:40.940836 10802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:40.941991 10802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data/instance:
uuid: "36ee4b64aa414116b120574ca2f24a1d"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "eeddf6a99515c4a7a9906b3dffc9d30e"
server_key_iv: "1d318a2d6dc6fd1c35a3d547a30dfa98"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.942396 10802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance:
uuid: "36ee4b64aa414116b120574ca2f24a1d"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "eeddf6a99515c4a7a9906b3dffc9d30e"
server_key_iv: "1d318a2d6dc6fd1c35a3d547a30dfa98"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.943787 10802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:40.944674 10818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.944923 10802 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:29:40.945027 10802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal
uuid: "36ee4b64aa414116b120574ca2f24a1d"
format_stamp: "Formatted at 2026-08-11 14:29:40 on dist-test-slave-cbbz"
server_key: "eeddf6a99515c4a7a9906b3dffc9d30e"
server_key_iv: "1d318a2d6dc6fd1c35a3d547a30dfa98"
server_key_version: "encryptionkey@0"
I20260811 14:29:40.945084 10802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:40.958192 10802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:40.958459 10802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:40.958568 10802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:40.958743 10802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:40.959081 10802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:40.959116 10802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.959173 10802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:40.959210 10802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:40.965278 10802 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.194:37897
I20260811 14:29:40.965335 10950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.194:37897 every 8 connection(s)
I20260811 14:29:40.965700 10802 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/data/info.pb
I20260811 14:29:40.970800 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.966434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.194:55307 (local address 127.20.132.254:37031)
0811 14:29:40.966500 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:40.966502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:40.966758 (+ 256us) server_negotiation.cc:407] Connection header received
0811 14:29:40.967228 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:40.967229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:40.967241 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:40.967302 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:40.967921 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.968503 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.969448 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.969637 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.969711 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.970522 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:40.970523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:40.970524 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:40.970528 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:40.970538 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:40.970541 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:40.970579 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:40.970720 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 14:29:40.970742 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:29:40.970793 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10802
I20260811 14:29:40.970904 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal/instance
I20260811 14:29:40.971091 10953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:40.966432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37031 (local address 127.20.132.194:55307)
0811 14:29:40.966628 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:40.966670 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:40.967145 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:40.967353 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:40.967356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:40.967364 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:40.967851 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.967855 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.968585 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.968586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.969368 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:40.969370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:40.969730 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:40.969731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:40.969835 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:40.970397 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:40.970397 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:40.970425 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:40.970448 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:40.970626 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:40.970632 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:40.970635 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:40.970712 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:29:40.970831 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260811 14:29:40.971129 21011 external_mini_cluster.cc:1428] Setting key c4f7dc83bf3fee8d83ba4117d5e3f924
I20260811 14:29:40.971653 10951 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37031
I20260811 14:29:40.971746 10951 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:40.971926 10951 heartbeater.cc:511] Master 127.20.132.254:37031 requested a full tablet report, sending...
I20260811 14:29:40.972360 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.132.195:0
--local_ip_for_outbound_sockets=127.20.132.195
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37031
--builtin_ntp_servers=127.20.132.212:36461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 14:29:40.972361 10585 ts_manager.cc:194] Registered new tserver with Master: 36ee4b64aa414116b120574ca2f24a1d (127.20.132.194:37897)
I20260811 14:29:40.972783 10585 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.194:55307
W20260811 14:29:41.055348 10954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:41.055542 10954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:41.055563 10954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:41.056804 10954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:41.056855 10954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:41.056905 10954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.132.195
I20260811 14:29:41.058225 10954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:36461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.132.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.132.195
--webserver_port=0
--tserver_master_addrs=127.20.132.254:37031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.132.195
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:41.058506 10954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:41.058823 10954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:41.063803 10960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:41.063865 10954 server_base.cc:1034] running on GCE node
W20260811 14:29:41.063828 10963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:41.063789 10959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:41.064256 10954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:41.064556 10954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:41.065737 10954 hybrid_clock.cc:648] HybridClock initialized: now 1786458581065718 us; error 32 us; skew 500 ppm
I20260811 14:29:41.067147 10954 webserver.cc:460] Webserver started at http://127.20.132.195:36037/ using document root <none> and password file <none>
I20260811 14:29:41.067397 10954 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:41.067461 10954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:41.067631 10954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:41.068727 10954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data/instance:
uuid: "90432d94e56a45db91c500c0c4f5d835"
format_stamp: "Formatted at 2026-08-11 14:29:41 on dist-test-slave-cbbz"
server_key: "ef537a403227241277604f708f906ce7"
server_key_iv: "3b1c31778fa80fc9a7643ef4632d5dfb"
server_key_version: "encryptionkey@0"
I20260811 14:29:41.069082 10954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance:
uuid: "90432d94e56a45db91c500c0c4f5d835"
format_stamp: "Formatted at 2026-08-11 14:29:41 on dist-test-slave-cbbz"
server_key: "ef537a403227241277604f708f906ce7"
server_key_iv: "3b1c31778fa80fc9a7643ef4632d5dfb"
server_key_version: "encryptionkey@0"
I20260811 14:29:41.070345 10954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:29:41.071069 10969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:41.071259 10954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:41.071345 10954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal
uuid: "90432d94e56a45db91c500c0c4f5d835"
format_stamp: "Formatted at 2026-08-11 14:29:41 on dist-test-slave-cbbz"
server_key: "ef537a403227241277604f708f906ce7"
server_key_iv: "3b1c31778fa80fc9a7643ef4632d5dfb"
server_key_version: "encryptionkey@0"
I20260811 14:29:41.071419 10954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:41.085170 10954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:41.085464 10954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:41.085638 10954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:41.085886 10954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:29:41.086212 10954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:29:41.086246 10954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:41.086268 10954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:29:41.086313 10954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:41.092597 10954 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.195:43751
I20260811 14:29:41.092741 11099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.195:43751 every 8 connection(s)
I20260811 14:29:41.093012 10954 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/data/info.pb
I20260811 14:29:41.097496 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 10954
I20260811 14:29:41.097618 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal/instance
I20260811 14:29:41.097854 21011 external_mini_cluster.cc:1428] Setting key c579506a180d0e385d4a655aa5ba46cd
I20260811 14:29:41.098237 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.093749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.195:59961 (local address 127.20.132.254:37031)
0811 14:29:41.093818 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.093821 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.094068 (+ 247us) server_negotiation.cc:407] Connection header received
0811 14:29:41.094515 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.094516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.094527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.094588 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:41.095202 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.095683 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.096657 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.096838 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.096888 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.097889 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:41.097890 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:41.097891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:41.097896 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:41.097913 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:41.097917 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:41.097979 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.098110 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.098140 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:29:41.098449 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.093738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:37031 (local address 127.20.132.195:59961)
0811 14:29:41.093924 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.093964 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:41.094430 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:41.094636 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:41.094638 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:41.094647 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:29:41.095128 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.095131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.095768 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.095768 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.096587 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.096590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.096910 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.096911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.097008 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.097687 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:29:41.097689 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:29:41.097746 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:29:41.097776 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:29:41.098014 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:29:41.098022 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:29:41.098025 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:41.098099 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 14:29:41.098189 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260811 14:29:41.099002 11100 heartbeater.cc:347] Connected to a master server at 127.20.132.254:37031
I20260811 14:29:41.099080 11100 heartbeater.cc:464] Registering TS with master...
I20260811 14:29:41.099274 11100 heartbeater.cc:511] Master 127.20.132.254:37031 requested a full tablet report, sending...
I20260811 14:29:41.099678 10585 ts_manager.cc:194] Registered new tserver with Master: 90432d94e56a45db91c500c0c4f5d835 (127.20.132.195:43751)
I20260811 14:29:41.100011 10585 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.132.195:59961
I20260811 14:29:41.109817 21011 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:29:41.113651 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.111139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49416 (local address 127.20.132.254:37031)
0811 14:29:41.111181 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.111183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.111249 (+ 66us) server_negotiation.cc:407] Connection header received
0811 14:29:41.111297 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.111297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.111304 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.111376 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:41.111504 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.111977 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.112680 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.112853 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.112907 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.113467 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:41.113469 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:41.113469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:41.113472 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:41.113485 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:41.113488 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:41.113534 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.113573 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.113597 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:29:41.115267 10585 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49416:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:29:41.116936 10585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:29:41.123703 11112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.119264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36338 (local address 127.20.132.194:37897)
0811 14:29:41.119674 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.119678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.119806 (+ 128us) server_negotiation.cc:407] Connection header received
0811 14:29:41.119887 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.119890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.119907 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.119986 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:41.120214 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.121029 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.122652 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.123321 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.123389 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.123459 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.123577 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.123620 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":116,"threads_started":1}
I20260811 14:29:41.123713 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.119078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37897 (local address 127.0.0.1:36338)
0811 14:29:41.119718 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.119726 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:41.119777 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:41.120051 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:41.120052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:41.120055 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:41.120101 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.120104 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.121119 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.121120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.122572 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.122575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.123398 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.123398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.123455 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.123473 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 14:29:41.123552 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:29:41.123619 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":97,"thread_start_us":120,"threads_started":1}
I20260811 14:29:41.123716 11109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.119088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43751 (local address 127.0.0.1:48416)
0811 14:29:41.119903 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.119912 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:41.119954 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:41.120258 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:41.120259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:41.120261 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:41.120289 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.120290 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.121445 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.121445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.122478 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.122481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.123374 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.123375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.123456 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.123473 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 14:29:41.123552 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:29:41.123619 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260811 14:29:41.124619 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.119076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44877 (local address 127.0.0.1:53854)
0811 14:29:41.119267 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.119320 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:41.119414 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:41.119968 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:41.119970 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:41.119973 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:41.120042 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.120044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.121418 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.121420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.122572 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.122575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.124399 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.124400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.124446 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.124449 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:41.124485 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 14:29:41.124543 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":2,"thread_start_us":56,"threads_started":1}
I20260811 14:29:41.124650 11115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.119483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53854 (local address 127.20.132.193:44877)
0811 14:29:41.119674 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.119678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.119687 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:29:41.119723 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.119724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.119737 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.119844 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:41.120180 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.121319 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.123496 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.124316 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.124389 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.124475 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.124501 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.124541 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
I20260811 14:29:41.125083 11114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.119294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48416 (local address 127.20.132.195:43751)
0811 14:29:41.120069 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.120073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.120094 (+ 21us) server_negotiation.cc:407] Connection header received
0811 14:29:41.120130 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.120132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.120171 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.120257 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:41.120352 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.121385 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.122562 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.123268 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.123354 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.123445 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.124967 (+ 1522us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.125013 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":116,"threads_started":1}
I20260811 14:29:41.124989 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 8506530dd7cd4de4854dad323974a84f (DEFAULT_TABLE table=test-table [id=7622d221190d4fb3a2aa11bce3c7529b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:41.125375 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8506530dd7cd4de4854dad323974a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:41.125308 10727 tablet_service.cc:1467] Processing CreateTablet for tablet 8506530dd7cd4de4854dad323974a84f (DEFAULT_TABLE table=test-table [id=7622d221190d4fb3a2aa11bce3c7529b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:41.125628 10727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8506530dd7cd4de4854dad323974a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:41.125701 11024 tablet_service.cc:1467] Processing CreateTablet for tablet 8506530dd7cd4de4854dad323974a84f (DEFAULT_TABLE table=test-table [id=7622d221190d4fb3a2aa11bce3c7529b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:29:41.126061 11024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8506530dd7cd4de4854dad323974a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:41.128875 11116 tablet_bootstrap.cc:492] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Bootstrap starting.
I20260811 14:29:41.129284 11118 tablet_bootstrap.cc:492] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Bootstrap starting.
I20260811 14:29:41.129730 11116 tablet_bootstrap.cc:654] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:41.129945 11118 tablet_bootstrap.cc:654] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:41.130105 11116 log.cc:824] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:41.130273 11118 log.cc:824] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:41.130676 11117 tablet_bootstrap.cc:492] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: Bootstrap starting.
I20260811 14:29:41.130928 11116 tablet_bootstrap.cc:492] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: No bootstrap required, opened a new log
I20260811 14:29:41.131000 11116 ts_tablet_manager.cc:1397] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:29:41.131302 11117 tablet_bootstrap.cc:654] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:41.131601 11117 log.cc:824] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:41.132194 11118 tablet_bootstrap.cc:492] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: No bootstrap required, opened a new log
I20260811 14:29:41.132267 11118 ts_tablet_manager.cc:1397] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:29:41.132462 11117 tablet_bootstrap.cc:492] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: No bootstrap required, opened a new log
I20260811 14:29:41.132534 11117 ts_tablet_manager.cc:1397] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:29:41.133618 11116 raft_consensus.cc:348] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.133808 11116 raft_consensus.cc:374] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:41.133847 11116 raft_consensus.cc:729] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90432d94e56a45db91c500c0c4f5d835, State: Initialized, Role: FOLLOWER
I20260811 14:29:41.133972 11116 consensus_queue.cc:260] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.134262 11116 ts_tablet_manager.cc:1428] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 14:29:41.134308 11100 heartbeater.cc:503] Master 127.20.132.254:37031 was elected leader, sending a full tablet report...
I20260811 14:29:41.134567 11118 raft_consensus.cc:348] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.134747 11118 raft_consensus.cc:374] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:41.134792 11118 raft_consensus.cc:729] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ee4b64aa414116b120574ca2f24a1d, State: Initialized, Role: FOLLOWER
I20260811 14:29:41.134912 11118 consensus_queue.cc:260] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.135165 11118 ts_tablet_manager.cc:1428] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:29:41.135288 10951 heartbeater.cc:503] Master 127.20.132.254:37031 was elected leader, sending a full tablet report...
I20260811 14:29:41.135283 11117 raft_consensus.cc:348] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.135443 11117 raft_consensus.cc:374] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:41.135490 11117 raft_consensus.cc:729] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25c8fc2a7f4f8693011905b36041e4, State: Initialized, Role: FOLLOWER
I20260811 14:29:41.135604 11117 consensus_queue.cc:260] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.135839 11117 ts_tablet_manager.cc:1428] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 14:29:41.135969 10798 heartbeater.cc:503] Master 127.20.132.254:37031 was elected leader, sending a full tablet report...
I20260811 14:29:41.147805 11124 raft_consensus.cc:482] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:29:41.147923 11124 raft_consensus.cc:504] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.148339 11124 leader_election.cc:288] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36ee4b64aa414116b120574ca2f24a1d (127.20.132.194:37897), 90432d94e56a45db91c500c0c4f5d835 (127.20.132.195:43751)
I20260811 14:29:41.151237 11112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.148609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:56019 (local address 127.20.132.194:37897)
0811 14:29:41.148760 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.148762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.148769 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:29:41.148793 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.148793 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.148805 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.148865 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:41.149052 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.149543 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.150490 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.150867 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.150949 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.150958 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.151128 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.151166 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260811 14:29:41.151237 10801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.148503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.194:37897 (local address 127.20.132.193:56019)
0811 14:29:41.148562 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.148574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:41.148615 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:41.148885 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:41.148887 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:41.148888 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:41.148958 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.148960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.149627 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.149628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.150398 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.150400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.150949 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.150950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.151022 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.151025 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:29:41.151117 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 14:29:41.151160 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 14:29:41.151628 10896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8506530dd7cd4de4854dad323974a84f" candidate_uuid: "4e25c8fc2a7f4f8693011905b36041e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36ee4b64aa414116b120574ca2f24a1d" is_pre_election: true
I20260811 14:29:41.151780 10896 raft_consensus.cc:2454] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25c8fc2a7f4f8693011905b36041e4 in term 0.
I20260811 14:29:41.151955 11114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.148610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.132.193:56775 (local address 127.20.132.195:43751)
0811 14:29:41.148682 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.148684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.148908 (+ 224us) server_negotiation.cc:407] Connection header received
0811 14:29:41.149005 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.149006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.149024 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.149084 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:29:41.149268 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.149812 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.150839 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.151225 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.151323 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.151334 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.151833 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.151875 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:29:41.152001 10670 leader_election.cc:302] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36ee4b64aa414116b120574ca2f24a1d, 4e25c8fc2a7f4f8693011905b36041e4; no voters:
I20260811 14:29:41.152169 11125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.148526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.195:43751 (local address 127.20.132.193:56775)
0811 14:29:41.148818 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.148829 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:29:41.148923 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:29:41.149090 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:29:41.149091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:29:41.149093 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:29:41.149180 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.149182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.149925 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.149927 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.150737 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:29:41.150739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.151656 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.151657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:29:41.151712 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.151716 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:29:41.151800 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:29:41.151846 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":115,"thread_start_us":120,"threads_started":1}
I20260811 14:29:41.152200 11124 raft_consensus.cc:2781] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:29:41.152258 11124 raft_consensus.cc:482] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:29:41.152284 11124 raft_consensus.cc:3037] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:41.152474 11048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8506530dd7cd4de4854dad323974a84f" candidate_uuid: "4e25c8fc2a7f4f8693011905b36041e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90432d94e56a45db91c500c0c4f5d835" is_pre_election: true
I20260811 14:29:41.152660 11048 raft_consensus.cc:2454] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25c8fc2a7f4f8693011905b36041e4 in term 0.
I20260811 14:29:41.153308 11124 raft_consensus.cc:504] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.153474 11124 leader_election.cc:288] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [CANDIDATE]: Term 1 election: Requested vote from peers 36ee4b64aa414116b120574ca2f24a1d (127.20.132.194:37897), 90432d94e56a45db91c500c0c4f5d835 (127.20.132.195:43751)
I20260811 14:29:41.153636 10896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8506530dd7cd4de4854dad323974a84f" candidate_uuid: "4e25c8fc2a7f4f8693011905b36041e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36ee4b64aa414116b120574ca2f24a1d"
I20260811 14:29:41.153723 10896 raft_consensus.cc:3037] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:41.154470 10896 raft_consensus.cc:2454] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25c8fc2a7f4f8693011905b36041e4 in term 1.
I20260811 14:29:41.154667 10670 leader_election.cc:302] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36ee4b64aa414116b120574ca2f24a1d, 4e25c8fc2a7f4f8693011905b36041e4; no voters:
I20260811 14:29:41.154695 11048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8506530dd7cd4de4854dad323974a84f" candidate_uuid: "4e25c8fc2a7f4f8693011905b36041e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90432d94e56a45db91c500c0c4f5d835"
I20260811 14:29:41.154790 11048 raft_consensus.cc:3037] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:41.155565 11048 raft_consensus.cc:2454] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25c8fc2a7f4f8693011905b36041e4 in term 1.
I20260811 14:29:41.155661 11124 raft_consensus.cc:2781] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:41.155882 11124 raft_consensus.cc:686] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4e25c8fc2a7f4f8693011905b36041e4, State: Running, Role: LEADER
I20260811 14:29:41.155987 11124 consensus_queue.cc:237] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } }
I20260811 14:29:41.156934 10586 catalog_manager.cc:5495] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e25c8fc2a7f4f8693011905b36041e4 (127.20.132.193). New cstate: current_term: 1 leader_uuid: "4e25c8fc2a7f4f8693011905b36041e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25c8fc2a7f4f8693011905b36041e4" member_type: VOTER last_known_addr { host: "127.20.132.193" port: 44877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 } health_report { overall_health: UNKNOWN } } }
I20260811 14:29:41.168793 11115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.166532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53866 (local address 127.20.132.193:44877)
0811 14:29:41.166596 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:41.166598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:41.166605 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:29:41.166634 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:41.166634 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:41.166651 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:41.166720 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:29:41.166856 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.167342 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.168090 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:41.168326 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:41.168378 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:41.168517 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:29:41.168607 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:29:41.168665 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:41.168710 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 14:29:41.168726 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:29:41.170599 11048 raft_consensus.cc:1261] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 1 FOLLOWER]: Refusing update from remote peer 4e25c8fc2a7f4f8693011905b36041e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:41.170600 10896 raft_consensus.cc:1261] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 1 FOLLOWER]: Refusing update from remote peer 4e25c8fc2a7f4f8693011905b36041e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:29:41.171036 11126 consensus_queue.cc:1035] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ee4b64aa414116b120574ca2f24a1d" member_type: VOTER last_known_addr { host: "127.20.132.194" port: 37897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:41.171221 11124 consensus_queue.cc:1035] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90432d94e56a45db91c500c0c4f5d835" member_type: VOTER last_known_addr { host: "127.20.132.195" port: 43751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:29:41.174710 11130 mvcc.cc:205] Tried to move back new op lower bound from 7317334348471930880 to 7317334348415832064. Current Snapshot: MvccSnapshot[applied={T|T < 7317334348471930880}]
I20260811 14:29:41.176273 10586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:41.176375 10586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:29:41.177258 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37674e2aad71492eb1412c339ed3d78c: Sending DeleteTablet for 3 replicas of tablet 8506530dd7cd4de4854dad323974a84f
I20260811 14:29:41.177620 10727 tablet_service.cc:1514] Processing DeleteTablet for tablet 8506530dd7cd4de4854dad323974a84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:41 UTC) from {username='slave'} at 127.0.0.1:53854
I20260811 14:29:41.177693 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 8506530dd7cd4de4854dad323974a84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:41 UTC) from {username='slave'} at 127.0.0.1:36338
I20260811 14:29:41.177904 11139 tablet_replica.cc:330] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: stopping tablet replica
I20260811 14:29:41.177915 11138 tablet_replica.cc:330] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4: stopping tablet replica
I20260811 14:29:41.178011 11139 raft_consensus.cc:2229] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:41.178108 11138 raft_consensus.cc:2229] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:29:41.178123 11139 raft_consensus.cc:2258] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:41.178131 11024 tablet_service.cc:1514] Processing DeleteTablet for tablet 8506530dd7cd4de4854dad323974a84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:29:41 UTC) from {username='slave'} at 127.0.0.1:48416
I20260811 14:29:41.178310 11138 raft_consensus.cc:2258] T 8506530dd7cd4de4854dad323974a84f P 4e25c8fc2a7f4f8693011905b36041e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:41.178519 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10653
I20260811 14:29:41.178529 11139 ts_tablet_manager.cc:1905] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:41.179181 11140 tablet_replica.cc:330] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: stopping tablet replica
I20260811 14:29:41.179332 11140 raft_consensus.cc:2229] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:29:41.179468 11140 raft_consensus.cc:2258] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:29:41.180052 11140 ts_tablet_manager.cc:1905] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:29:41.180330 11139 ts_tablet_manager.cc:1918] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:41.180418 11139 log.cc:1196] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-1/wal/wals/8506530dd7cd4de4854dad323974a84f
I20260811 14:29:41.180670 11139 ts_tablet_manager.cc:1939] T 8506530dd7cd4de4854dad323974a84f P 36ee4b64aa414116b120574ca2f24a1d: Deleting consensus metadata
I20260811 14:29:41.181085 10568 catalog_manager.cc:4841] TS 36ee4b64aa414116b120574ca2f24a1d (127.20.132.194:37897): tablet 8506530dd7cd4de4854dad323974a84f (table test-table [id=7622d221190d4fb3a2aa11bce3c7529b]) successfully deleted
I20260811 14:29:41.182126 11140 ts_tablet_manager.cc:1918] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:29:41.182206 11140 log.cc:1196] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Deleting WAL directory at /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786458335845753-21011-0/minicluster-data/ts-2/wal/wals/8506530dd7cd4de4854dad323974a84f
I20260811 14:29:41.182454 11140 ts_tablet_manager.cc:1939] T 8506530dd7cd4de4854dad323974a84f P 90432d94e56a45db91c500c0c4f5d835: Deleting consensus metadata
I20260811 14:29:41.182869 10572 catalog_manager.cc:4841] TS 90432d94e56a45db91c500c0c4f5d835 (127.20.132.195:43751): tablet 8506530dd7cd4de4854dad323974a84f (table test-table [id=7622d221190d4fb3a2aa11bce3c7529b]) successfully deleted
W20260811 14:29:41.187493 10571 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.132.193:44877 (error 108)
I20260811 14:29:41.187774 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10802
I20260811 14:29:41.187989 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:41.187866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.193:44877 (local address 127.0.0.1:53878)
0811 14:29:41.187917 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 14:29:41.187952 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.193:44877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:29:41.188093 10571 catalog_manager.cc:4584] TS 4e25c8fc2a7f4f8693011905b36041e4 (127.20.132.193:44877): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8506530dd7cd4de4854dad323974a84f: Network error: Client connection negotiation failed: client connection to 127.20.132.193:44877: connect: Connection refused (error 111)
I20260811 14:29:41.195585 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10954
I20260811 14:29:41.203366 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 10553
2026-08-11T14:29:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (685 ms)
[----------] 6 tests from EncryptionPolicyTest (8150 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:41 dist-test-slave-cbbz krb5kdc[11145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:41 dist-test-slave-cbbz krb5kdc[11145](info): set up 2 sockets
Aug 11 14:29:41 dist-test-slave-cbbz krb5kdc[11145](info): commencing operation
krb5kdc: starting...
W20260811 14:29:42.302522 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:42 dist-test-slave-cbbz krb5kdc[11145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:42.418596 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38217
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:42.498764 11163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:42.498992 11163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:42.499029 11163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:42.500239 11163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:42.500299 11163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:42.500324 11163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:42.500357 11163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:42.500387 11163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:42.501863 11163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38217
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:42.502130 11163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:42.502365 11163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:42.507241 11168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:42.507263 11169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:42.507299 11171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:42.507350 11163 server_base.cc:1034] running on GCE node
I20260811 14:29:42.507730 11163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:42.508023 11163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:42.509186 11163 hybrid_clock.cc:648] HybridClock initialized: now 1786458582509165 us; error 44 us; skew 500 ppm
Aug 11 14:29:42 dist-test-slave-cbbz krb5kdc[11145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458582, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:42.512223 11163 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:42.512641 11163 webserver.cc:460] Webserver started at http://127.0.0.1:35817/ using document root <none> and password file <none>
I20260811 14:29:42.512822 11163 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:42.512866 11163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:42.513044 11163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:42.514096 11163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "c9d7d78c67fb45afa850405dd71ed5a1"
format_stamp: "Formatted at 2026-08-11 14:29:42 on dist-test-slave-cbbz"
server_key: "a91245185641554c403f3ae503a1780e"
server_key_iv: "2ece1ab4a76fa323c35f3e73b14c1478"
server_key_version: "encryptionkey@0"
I20260811 14:29:42.514420 11163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "c9d7d78c67fb45afa850405dd71ed5a1"
format_stamp: "Formatted at 2026-08-11 14:29:42 on dist-test-slave-cbbz"
server_key: "a91245185641554c403f3ae503a1780e"
server_key_iv: "2ece1ab4a76fa323c35f3e73b14c1478"
server_key_version: "encryptionkey@0"
I20260811 14:29:42.515729 11163 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:42.516515 11178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:42.516706 11163 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:42.516785 11163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "c9d7d78c67fb45afa850405dd71ed5a1"
format_stamp: "Formatted at 2026-08-11 14:29:42 on dist-test-slave-cbbz"
server_key: "a91245185641554c403f3ae503a1780e"
server_key_iv: "2ece1ab4a76fa323c35f3e73b14c1478"
server_key_version: "encryptionkey@0"
I20260811 14:29:42.516841 11163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:42.534251 11163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:42.536250 11163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:42.536384 11163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:42.540657 11163 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38217
I20260811 14:29:42.540690 11238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38217 every 8 connection(s)
I20260811 14:29:42.541096 11163 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:42.541996 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:42.543298 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11163
I20260811 14:29:42.543401 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:42.543660 21011 external_mini_cluster.cc:1428] Setting key 83386f327c6b7f666a1510cf298b5224
I20260811 14:29:42.544629 11239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1: Bootstrap starting.
I20260811 14:29:42.545224 11239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:42.545532 11239 log.cc:824] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:42.546244 11239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1: No bootstrap required, opened a new log
I20260811 14:29:42.547966 11239 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38217 } }
I20260811 14:29:42.548125 11239 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:42.548244 11239 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d7d78c67fb45afa850405dd71ed5a1, State: Initialized, Role: FOLLOWER
I20260811 14:29:42.548404 11239 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38217 } }
I20260811 14:29:42.548501 11239 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:42.548534 11239 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:42.548578 11239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:42.549234 11239 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38217 } }
I20260811 14:29:42.549361 11239 leader_election.cc:302] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9d7d78c67fb45afa850405dd71ed5a1; no voters:
I20260811 14:29:42.549567 11239 leader_election.cc:288] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:42.549587 11247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:42.549723 11247 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [term 1 LEADER]: Becoming Leader. State: Replica: c9d7d78c67fb45afa850405dd71ed5a1, State: Running, Role: LEADER
I20260811 14:29:42.549842 11239 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 14:29:42 dist-test-slave-cbbz krb5kdc[11145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 14:29:42.549821 11247 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38217 } }
I20260811 14:29:42.551690 11249 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38217 } } }
I20260811 14:29:42.551878 11248 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9d7d78c67fb45afa850405dd71ed5a1. Latest consensus state: current_term: 1 leader_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d7d78c67fb45afa850405dd71ed5a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38217 } } }
I20260811 14:29:42.552294 11249 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:42.552307 11248 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1 [sys.catalog]: This master's current role is: LEADER
W20260811 14:29:42.552824 11261 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:29:42.552908 11261 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:29:42.552987 11264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:42.553169 11264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:42.554752 11264 catalog_manager.cc:1347] Generated new cluster ID: 8773d7a5187e40bfbb3d97023b46d111
I20260811 14:29:42.554808 11264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:42.555716 11245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:42.544304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57603 (local address 127.0.0.1:38217)
0811 14:29:42.544503 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:42.544526 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:42.544554 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:29:42.545015 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:42.545024 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:42.545073 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:42.545230 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:42.546014 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:42.546980 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:42.547766 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:42.548275 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:42.548401 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:42.551507 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:42.551512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:42.551512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:42.551535 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:42.553677 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:42.554208 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:42.554212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:42.554212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:42.554336 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:42.554609 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:42.554610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:42.554610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:42.554943 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:42.555107 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:42.555368 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 14:29:42.555482 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260811 14:29:42.556706 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:42.560371 11264 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:42.561087 11264 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:42.565951 11245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:42.558177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59183 (local address 127.0.0.1:38217)
0811 14:29:42.558218 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:42.558220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:42.558419 (+ 199us) server_negotiation.cc:407] Connection header received
0811 14:29:42.558516 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:42.558517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:42.558527 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:42.558558 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:42.559314 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:42.559990 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:42.561230 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:42.561530 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:42.561572 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:42.563060 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:42.563061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:42.563062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:42.563069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:42.564711 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:42.565133 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:42.565134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:42.565134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:42.565194 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:42.565433 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:42.565434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:42.565434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:42.565552 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:42.565653 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:42.565795 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 14:29:42.565859 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 14:29:42.566654 11264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9d7d78c67fb45afa850405dd71ed5a1: Generated new TSK 0
I20260811 14:29:42.566835 11264 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:42.570772 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11163
W20260811 14:29:42.579608 11142 connection.cc:535] client connection to 127.0.0.1:38217 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38217): Connection reset by peer (error 104)
2026-08-11T14:29:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1369 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:42 dist-test-slave-cbbz krb5kdc[11275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:42 dist-test-slave-cbbz krb5kdc[11275](info): set up 2 sockets
Aug 11 14:29:42 dist-test-slave-cbbz krb5kdc[11275](info): commencing operation
krb5kdc: starting...
W20260811 14:29:43.671538 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:43 dist-test-slave-cbbz krb5kdc[11275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:43.790453 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34111
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:43.871779 11289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:43.871984 11289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:43.872006 11289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:43.873114 11289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:43.873149 11289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:43.873163 11289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:43.873175 11289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:43.873188 11289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:43.874575 11289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34111
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:43.874756 11289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:43.874918 11289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:43.880206 11296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:43.880206 11295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:43.880235 11298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:43.880545 11289 server_base.cc:1034] running on GCE node
I20260811 14:29:43.880820 11289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:43.881105 11289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:43.882277 11289 hybrid_clock.cc:648] HybridClock initialized: now 1786458583882264 us; error 32 us; skew 500 ppm
Aug 11 14:29:43 dist-test-slave-cbbz krb5kdc[11275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458583, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:43.884900 11289 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:43.885347 11289 webserver.cc:460] Webserver started at http://127.0.0.1:45191/ using document root <none> and password file <none>
I20260811 14:29:43.885527 11289 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:43.885566 11289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:43.885684 11289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:43.886716 11289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "c2a85ffc73424c209f21cf76c9452479"
format_stamp: "Formatted at 2026-08-11 14:29:43 on dist-test-slave-cbbz"
server_key: "7837ba82bfd8bdeecb3b3e6577fc9841"
server_key_iv: "774a9a7fbeda71e0af1ffd74ec8ed3e6"
server_key_version: "encryptionkey@0"
I20260811 14:29:43.887012 11289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "c2a85ffc73424c209f21cf76c9452479"
format_stamp: "Formatted at 2026-08-11 14:29:43 on dist-test-slave-cbbz"
server_key: "7837ba82bfd8bdeecb3b3e6577fc9841"
server_key_iv: "774a9a7fbeda71e0af1ffd74ec8ed3e6"
server_key_version: "encryptionkey@0"
I20260811 14:29:43.888343 11289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 14:29:43.889045 11305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:43.889240 11289 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:43.889322 11289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "c2a85ffc73424c209f21cf76c9452479"
format_stamp: "Formatted at 2026-08-11 14:29:43 on dist-test-slave-cbbz"
server_key: "7837ba82bfd8bdeecb3b3e6577fc9841"
server_key_iv: "774a9a7fbeda71e0af1ffd74ec8ed3e6"
server_key_version: "encryptionkey@0"
I20260811 14:29:43.889375 11289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:43.895560 11289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:43.897383 11289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:43.897490 11289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:43.901351 11289 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34111
I20260811 14:29:43.901448 11364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34111 every 8 connection(s)
I20260811 14:29:43.901741 11289 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:43.902611 11365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:43.904968 11365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479: Bootstrap starting.
I20260811 14:29:43.905001 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11289
I20260811 14:29:43.905121 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:43.905349 21011 external_mini_cluster.cc:1428] Setting key 521d90a895f297c4e111144f5dd6b26b
I20260811 14:29:43.905706 11365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:43.906134 11365 log.cc:824] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:43.906908 11365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479: No bootstrap required, opened a new log
I20260811 14:29:43.909085 11365 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a85ffc73424c209f21cf76c9452479" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260811 14:29:43.909233 11365 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:43.909256 11365 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2a85ffc73424c209f21cf76c9452479, State: Initialized, Role: FOLLOWER
I20260811 14:29:43.909402 11365 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a85ffc73424c209f21cf76c9452479" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260811 14:29:43.909476 11365 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:43.909541 11365 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:43.909598 11365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:43.910362 11365 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a85ffc73424c209f21cf76c9452479" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260811 14:29:43.910467 11365 leader_election.cc:302] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2a85ffc73424c209f21cf76c9452479; no voters:
I20260811 14:29:43.910660 11365 leader_election.cc:288] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:43.910684 11370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:43.910799 11370 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [term 1 LEADER]: Becoming Leader. State: Replica: c2a85ffc73424c209f21cf76c9452479, State: Running, Role: LEADER
I20260811 14:29:43.910917 11365 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:43.910959 11370 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a85ffc73424c209f21cf76c9452479" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260811 14:29:43.911258 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:43.905861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36419 (local address 127.0.0.1:34111)
0811 14:29:43.906042 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:43.906050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:43.906074 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:29:43.906538 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:43.906545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:43.906590 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:43.906715 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:43.906985 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:43.907842 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:43.909045 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:43.909597 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:43.909706 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:43.910378 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:43.910381 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:43.910382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:43.910619 (+ 237us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:43.910661 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:43.910672 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:43.910993 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:43.911039 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 14:29:43.911068 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260811 14:29:43.911274 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2a85ffc73424c209f21cf76c9452479. Latest consensus state: current_term: 1 leader_uuid: "c2a85ffc73424c209f21cf76c9452479" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a85ffc73424c209f21cf76c9452479" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } } }
I20260811 14:29:43.911408 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:43.911285 11371 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2a85ffc73424c209f21cf76c9452479" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a85ffc73424c209f21cf76c9452479" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } } }
I20260811 14:29:43.911859 11371 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:43.912403 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 14:29:43.912750 11387 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:29:43.913125 11387 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:29:43.913208 11379 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:43.913388 11379 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:43.914891 11379 catalog_manager.cc:1347] Generated new cluster ID: 856f18effcf3489fa5a1f5d160449646
I20260811 14:29:43.914945 11379 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:43.917294 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:43.914214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42551 (local address 127.0.0.1:34111)
0811 14:29:43.914249 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:43.914251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:43.914323 (+ 72us) server_negotiation.cc:407] Connection header received
0811 14:29:43.914410 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:43.914411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:43.914423 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:43.914474 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:43.914628 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:43.915251 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:43.915968 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:43.916264 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:43.916350 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:43.917036 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:43.917037 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:43.917037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:43.917041 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:43.917055 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:43.917060 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:43.917114 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:43.917192 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 14:29:43.917201 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 14:29:43.928402 11379 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:43.929080 11379 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:43.936256 11379 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2a85ffc73424c209f21cf76c9452479: Generated new TSK 0
I20260811 14:29:43.936429 11379 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:43.945044 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11289
W20260811 14:29:43.952518 11273 connection.cc:535] client connection to 127.0.0.1:34111 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34111): Connection reset by peer (error 104)
2026-08-11T14:29:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1372 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:44 dist-test-slave-cbbz krb5kdc[11402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:44 dist-test-slave-cbbz krb5kdc[11402](info): set up 2 sockets
Aug 11 14:29:44 dist-test-slave-cbbz krb5kdc[11402](info): commencing operation
krb5kdc: starting...
W20260811 14:29:45.035107 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:45 dist-test-slave-cbbz krb5kdc[11402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:45.158776 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34763
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:45.240113 11415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:45.240382 11415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:45.240420 11415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:45.241564 11415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:45.241647 11415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:45.241676 11415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:45.241709 11415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:45.241731 11415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:45.243209 11415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34763
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:45.243484 11415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:45.243734 11415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:45.248468 11421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:45.248515 11422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:45.248523 11424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:45.248808 11415 server_base.cc:1034] running on GCE node
I20260811 14:29:45.249046 11415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:45.249361 11415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:45.250566 11415 hybrid_clock.cc:648] HybridClock initialized: now 1786458585250549 us; error 46 us; skew 500 ppm
Aug 11 14:29:45 dist-test-slave-cbbz krb5kdc[11402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458585, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:45.253234 11415 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:45.253734 11415 webserver.cc:460] Webserver started at http://127.0.0.1:38181/ using document root <none> and password file <none>
I20260811 14:29:45.253969 11415 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:45.254035 11415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:45.254191 11415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:45.255314 11415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "f772a8b7ab0e4144816caa512c338886"
format_stamp: "Formatted at 2026-08-11 14:29:45 on dist-test-slave-cbbz"
server_key: "1154fea3f26a2b72c6462d12fb06dfb0"
server_key_iv: "8750e3cd1e64cc2df9f36e746e322013"
server_key_version: "encryptionkey@0"
I20260811 14:29:45.255692 11415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "f772a8b7ab0e4144816caa512c338886"
format_stamp: "Formatted at 2026-08-11 14:29:45 on dist-test-slave-cbbz"
server_key: "1154fea3f26a2b72c6462d12fb06dfb0"
server_key_iv: "8750e3cd1e64cc2df9f36e746e322013"
server_key_version: "encryptionkey@0"
I20260811 14:29:45.257104 11415 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 14:29:45.257828 11431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:45.257992 11415 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:45.258102 11415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "f772a8b7ab0e4144816caa512c338886"
format_stamp: "Formatted at 2026-08-11 14:29:45 on dist-test-slave-cbbz"
server_key: "1154fea3f26a2b72c6462d12fb06dfb0"
server_key_iv: "8750e3cd1e64cc2df9f36e746e322013"
server_key_version: "encryptionkey@0"
I20260811 14:29:45.258176 11415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:45.261401 11415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:45.263713 11415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:45.263861 11415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:45.267788 11415 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34763
I20260811 14:29:45.267825 11488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34763 every 8 connection(s)
I20260811 14:29:45.268194 11415 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:45.269173 11489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:45.271281 11489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886: Bootstrap starting.
I20260811 14:29:45.271796 11489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:45.272028 11489 log.cc:824] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:45.272723 11489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886: No bootstrap required, opened a new log
I20260811 14:29:45.273875 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11415
I20260811 14:29:45.274032 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:45.274231 21011 external_mini_cluster.cc:1428] Setting key 3b7ed489d8400158ec6c0738d12cf59a
I20260811 14:29:45.274401 11489 raft_consensus.cc:348] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f772a8b7ab0e4144816caa512c338886" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34763 } }
I20260811 14:29:45.274583 11489 raft_consensus.cc:374] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:45.274690 11489 raft_consensus.cc:729] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f772a8b7ab0e4144816caa512c338886, State: Initialized, Role: FOLLOWER
I20260811 14:29:45.274853 11489 consensus_queue.cc:260] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f772a8b7ab0e4144816caa512c338886" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34763 } }
I20260811 14:29:45.274966 11489 raft_consensus.cc:388] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:45.275013 11489 raft_consensus.cc:482] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:45.275067 11489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:45.276211 11489 raft_consensus.cc:504] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f772a8b7ab0e4144816caa512c338886" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34763 } }
I20260811 14:29:45.276321 11489 leader_election.cc:302] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f772a8b7ab0e4144816caa512c338886; no voters:
I20260811 14:29:45.276460 11489 leader_election.cc:288] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:45.276492 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:45.274791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54061 (local address 127.0.0.1:34763)
0811 14:29:45.275004 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:45.275013 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:45.275048 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:29:45.275173 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:45.275180 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:45.275211 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:45.275359 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:45.275999 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:45.276003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:45.276004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:45.276008 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:45.276058 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:45.276074 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:45.276189 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:45.276261 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 14:29:45.276302 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":107,"threads_started":1}
I20260811 14:29:45.276512 11494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:45.276707 11494 raft_consensus.cc:686] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [term 1 LEADER]: Becoming Leader. State: Replica: f772a8b7ab0e4144816caa512c338886, State: Running, Role: LEADER
I20260811 14:29:45.276726 11489 sys_catalog.cc:564] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:45.276787 11494 consensus_queue.cc:237] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f772a8b7ab0e4144816caa512c338886" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34763 } }
I20260811 14:29:45.277145 11496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f772a8b7ab0e4144816caa512c338886. Latest consensus state: current_term: 1 leader_uuid: "f772a8b7ab0e4144816caa512c338886" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f772a8b7ab0e4144816caa512c338886" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34763 } } }
I20260811 14:29:45.277235 11496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:45.277415 11495 sys_catalog.cc:455] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f772a8b7ab0e4144816caa512c338886" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f772a8b7ab0e4144816caa512c338886" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34763 } } }
I20260811 14:29:45.277519 11495 sys_catalog.cc:458] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:45.278254 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 14:29:45.278548 11512 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:29:45.278605 11512 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:29:45.278649 11503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:45.278788 11503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:45.280567 11503 catalog_manager.cc:1347] Generated new cluster ID: 1fc5886f74e54fc38896e767f6c6bb04
I20260811 14:29:45.280632 11503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:45.280941 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:45.279825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58409 (local address 127.0.0.1:34763)
0811 14:29:45.279858 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:45.279860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:45.279910 (+ 50us) server_negotiation.cc:407] Connection header received
0811 14:29:45.279985 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:45.279986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:45.279991 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:45.280047 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:45.280706 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:45.280707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:45.280707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:45.280712 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:45.280726 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:45.280731 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:45.280800 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:45.280871 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 14:29:45.280884 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:29:45.298975 11503 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:45.299161 11503 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:45.315562 11503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f772a8b7ab0e4144816caa512c338886: Generated new TSK 0
I20260811 14:29:45.315764 11503 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:45.321638 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11415
2026-08-11T14:29:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1376 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:45 dist-test-slave-cbbz krb5kdc[11523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:45 dist-test-slave-cbbz krb5kdc[11523](info): set up 2 sockets
Aug 11 14:29:45 dist-test-slave-cbbz krb5kdc[11523](info): commencing operation
krb5kdc: starting...
W20260811 14:29:46.422772 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:46 dist-test-slave-cbbz krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:46.543784 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37627
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:46.626358 11537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:46.626600 11537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:46.626641 11537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:46.627800 11537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:46.627988 11537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:46.628088 11537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:46.628115 11537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:46.628175 11537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:46.629801 11537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:46.630070 11537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:46.630317 11537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:46.635215 11548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:46.635229 11542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:46.635229 11544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:46.635532 11537 server_base.cc:1034] running on GCE node
I20260811 14:29:46.635723 11537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:46.635947 11537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:46.637123 11537 hybrid_clock.cc:648] HybridClock initialized: now 1786458586637093 us; error 62 us; skew 500 ppm
Aug 11 14:29:46 dist-test-slave-cbbz krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458586, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:46.644429 11537 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:46.644984 11537 webserver.cc:460] Webserver started at http://127.0.0.1:37069/ using document root <none> and password file <none>
I20260811 14:29:46.645318 11537 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:46.645375 11537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:46.645560 11537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:46.647080 11537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "40584303957d4026aae06792e573eb03"
format_stamp: "Formatted at 2026-08-11 14:29:46 on dist-test-slave-cbbz"
server_key: "c3aa4d0f26eabf97a7f770946ff16579"
server_key_iv: "08d38de57ecfa77c5928256163a0a067"
server_key_version: "encryptionkey@0"
I20260811 14:29:46.647490 11537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "40584303957d4026aae06792e573eb03"
format_stamp: "Formatted at 2026-08-11 14:29:46 on dist-test-slave-cbbz"
server_key: "c3aa4d0f26eabf97a7f770946ff16579"
server_key_iv: "08d38de57ecfa77c5928256163a0a067"
server_key_version: "encryptionkey@0"
I20260811 14:29:46.649022 11537 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 14:29:46.649857 11558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:46.650035 11537 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:46.650148 11537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "40584303957d4026aae06792e573eb03"
format_stamp: "Formatted at 2026-08-11 14:29:46 on dist-test-slave-cbbz"
server_key: "c3aa4d0f26eabf97a7f770946ff16579"
server_key_iv: "08d38de57ecfa77c5928256163a0a067"
server_key_version: "encryptionkey@0"
I20260811 14:29:46.650226 11537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:46.663412 11537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:46.665899 11537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:46.666077 11537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:46.670447 11537 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37627
I20260811 14:29:46.670488 11615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37627 every 8 connection(s)
I20260811 14:29:46.670852 11537 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:46.671720 11616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:46.673990 11616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03: Bootstrap starting.
I20260811 14:29:46.674613 11616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:46.674911 11616 log.cc:824] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:46.675606 11616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03: No bootstrap required, opened a new log
I20260811 14:29:46.677266 11616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40584303957d4026aae06792e573eb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37627 } }
I20260811 14:29:46.677398 11616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:46.677419 11616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40584303957d4026aae06792e573eb03, State: Initialized, Role: FOLLOWER
I20260811 14:29:46.677578 11616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40584303957d4026aae06792e573eb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37627 } }
I20260811 14:29:46.677637 11616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:46.677657 11616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:46.677727 11616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:46.678267 11616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40584303957d4026aae06792e573eb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37627 } }
I20260811 14:29:46.678380 11616 leader_election.cc:302] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40584303957d4026aae06792e573eb03; no voters:
I20260811 14:29:46.678568 11616 leader_election.cc:288] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:46.678611 11620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:46.678800 11620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [term 1 LEADER]: Becoming Leader. State: Replica: 40584303957d4026aae06792e573eb03, State: Running, Role: LEADER
I20260811 14:29:46.678922 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11537
I20260811 14:29:46.678846 11616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:46.679036 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:46.679005 11620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40584303957d4026aae06792e573eb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37627 } }
I20260811 14:29:46.679224 21011 external_mini_cluster.cc:1428] Setting key e98067250cc095bd8ddd5abe45db4f53
I20260811 14:29:46.679378 11622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40584303957d4026aae06792e573eb03. Latest consensus state: current_term: 1 leader_uuid: "40584303957d4026aae06792e573eb03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40584303957d4026aae06792e573eb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37627 } } }
I20260811 14:29:46.679455 11621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40584303957d4026aae06792e573eb03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40584303957d4026aae06792e573eb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37627 } } }
I20260811 14:29:46.679513 11621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:46.679472 11622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:46.679822 11624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:46.680402 11624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:46.682256 11624 catalog_manager.cc:1347] Generated new cluster ID: f8dc57ece23442a692d9aac44c1c6456
I20260811 14:29:46.682309 11624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:29:46 dist-test-slave-cbbz krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 14:29:46.691250 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:46.679802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37195 (local address 127.0.0.1:37627)
0811 14:29:46.680127 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:46.680157 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:46.680202 (+ 45us) server_negotiation.cc:407] Connection header received
0811 14:29:46.680329 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:46.680338 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:46.680403 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:46.681383 (+ 980us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:46.681548 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:46.682971 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:46.684041 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:46.684636 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:46.684737 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:46.687489 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:46.687494 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:46.687495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:46.687509 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:46.689595 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:46.690013 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:46.690016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:46.690017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:46.690137 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:46.690342 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:46.690343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:46.690343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:46.690657 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:46.690831 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:46.690902 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 14:29:46.691035 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":74,"threads_started":1}
I20260811 14:29:46.692281 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:46.700707 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:46.693660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49331 (local address 127.0.0.1:37627)
0811 14:29:46.693700 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:46.693701 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:46.693873 (+ 172us) server_negotiation.cc:407] Connection header received
0811 14:29:46.693916 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:46.693916 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:46.693927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:46.693986 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:46.694570 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:46.695345 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:46.696342 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:46.696675 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:46.696748 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:46.697967 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:46.697968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:46.697969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:46.697975 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:46.699585 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:46.699968 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:46.699969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:46.699969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:46.700027 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:46.700224 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:46.700225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:46.700225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:46.700344 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:46.700436 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:46.700540 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 14:29:46.700613 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:29:46.712481 11624 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:46.713191 11624 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:46.721859 11624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40584303957d4026aae06792e573eb03: Generated new TSK 0
I20260811 14:29:46.722035 11624 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:46.725847 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11537
2026-08-11T14:29:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1405 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:46 dist-test-slave-cbbz krb5kdc[11651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:46 dist-test-slave-cbbz krb5kdc[11651](info): set up 2 sockets
Aug 11 14:29:46 dist-test-slave-cbbz krb5kdc[11651](info): commencing operation
krb5kdc: starting...
W20260811 14:29:47.823378 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:47 dist-test-slave-cbbz krb5kdc[11651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:47.944703 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37347
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:48.025640 11665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:48.025883 11665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:48.025921 11665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:48.027096 11665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:48.027172 11665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:48.027199 11665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:48.027226 11665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:48.027253 11665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:48.028728 11665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:48.028996 11665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:48.029227 11665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:48.034003 11678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:48.034004 11671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:48.034093 11673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:48.034257 11665 server_base.cc:1034] running on GCE node
I20260811 14:29:48.034483 11665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:48.034746 11665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:48.035902 11665 hybrid_clock.cc:648] HybridClock initialized: now 1786458588035876 us; error 41 us; skew 500 ppm
Aug 11 14:29:48 dist-test-slave-cbbz krb5kdc[11651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458588, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:48.038419 11665 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:48.038861 11665 webserver.cc:460] Webserver started at http://127.0.0.1:42429/ using document root <none> and password file <none>
I20260811 14:29:48.039031 11665 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:48.039068 11665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:48.039150 11665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:48.040212 11665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "07d7b3ced5e5401cbab5b686a34e8ca0"
format_stamp: "Formatted at 2026-08-11 14:29:48 on dist-test-slave-cbbz"
server_key: "d91208d7ff8ba3e7e5ef18615d43ff4f"
server_key_iv: "ac58712afe44a93aa322dcf1aa116e7a"
server_key_version: "encryptionkey@0"
I20260811 14:29:48.040525 11665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "07d7b3ced5e5401cbab5b686a34e8ca0"
format_stamp: "Formatted at 2026-08-11 14:29:48 on dist-test-slave-cbbz"
server_key: "d91208d7ff8ba3e7e5ef18615d43ff4f"
server_key_iv: "ac58712afe44a93aa322dcf1aa116e7a"
server_key_version: "encryptionkey@0"
I20260811 14:29:48.041752 11665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:48.042426 11686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:48.042589 11665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:48.042680 11665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "07d7b3ced5e5401cbab5b686a34e8ca0"
format_stamp: "Formatted at 2026-08-11 14:29:48 on dist-test-slave-cbbz"
server_key: "d91208d7ff8ba3e7e5ef18615d43ff4f"
server_key_iv: "ac58712afe44a93aa322dcf1aa116e7a"
server_key_version: "encryptionkey@0"
I20260811 14:29:48.042734 11665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:48.055775 11665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:48.057615 11665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:48.057726 11665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:48.061739 11665 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37347
I20260811 14:29:48.061805 11744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37347 every 8 connection(s)
I20260811 14:29:48.062240 11665 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:48.063195 11745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:48.065948 11745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0: Bootstrap starting.
I20260811 14:29:48.066530 11745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:48.066811 11745 log.cc:824] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:48.067505 11745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0: No bootstrap required, opened a new log
I20260811 14:29:48.069242 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11665
I20260811 14:29:48.069365 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:48.069226 11745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37347 } }
I20260811 14:29:48.069397 11745 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:48.069451 11745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d7b3ced5e5401cbab5b686a34e8ca0, State: Initialized, Role: FOLLOWER
I20260811 14:29:48.069605 21011 external_mini_cluster.cc:1428] Setting key f33822fdd5a189cdcfc5324b7769d565
I20260811 14:29:48.069614 11745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37347 } }
I20260811 14:29:48.069700 11745 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:48.069741 11745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:48.069798 11745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:48.070873 11745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37347 } }
I20260811 14:29:48.071010 11745 leader_election.cc:302] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07d7b3ced5e5401cbab5b686a34e8ca0; no voters:
I20260811 14:29:48.071177 11745 leader_election.cc:288] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:48.071234 11752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:48.071410 11752 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [term 1 LEADER]: Becoming Leader. State: Replica: 07d7b3ced5e5401cbab5b686a34e8ca0, State: Running, Role: LEADER
I20260811 14:29:48.071419 11745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:48.071539 11752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37347 } }
I20260811 14:29:48.071882 11752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07d7b3ced5e5401cbab5b686a34e8ca0. Latest consensus state: current_term: 1 leader_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37347 } } }
I20260811 14:29:48.072114 11752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:48.072028 11753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07d7b3ced5e5401cbab5b686a34e8ca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37347 } } }
I20260811 14:29:48.072578 11753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:48.072659 11761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:48.073246 11761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:48.075063 11761 catalog_manager.cc:1347] Generated new cluster ID: 257c9a72cf044672b08978482d309081
I20260811 14:29:48.075116 11761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:48.075721 11751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:48.070059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56015 (local address 127.0.0.1:37347)
0811 14:29:48.070301 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:48.070311 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:48.070352 (+ 41us) server_negotiation.cc:407] Connection header received
0811 14:29:48.070493 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:48.070501 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:48.070563 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:48.070750 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:48.070941 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:48.072445 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:48.073600 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:48.074210 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:48.074323 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:48.075010 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:48.075013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:48.075014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:48.075247 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:48.075285 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:48.075299 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:48.075370 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:48.075454 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 14:29:48.075516 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":129,"threads_started":1}
I20260811 14:29:48.076593 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:48.081359 11751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:48.077921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59347 (local address 127.0.0.1:37347)
0811 14:29:48.077960 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:48.077962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:48.078155 (+ 193us) server_negotiation.cc:407] Connection header received
0811 14:29:48.078177 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:48.078178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:48.078189 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:48.078245 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:48.078361 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:48.079073 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:48.080029 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:48.080394 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:48.080470 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:48.081120 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:48.081128 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:48.081129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:48.081134 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:48.081150 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:48.081154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:48.081216 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:48.081269 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 14:29:48.081293 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 14:29:48.088546 11761 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:48.089092 11761 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:48.094600 11761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07d7b3ced5e5401cbab5b686a34e8ca0: Generated new TSK 0
I20260811 14:29:48.094770 11761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:48.102335 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11665
2026-08-11T14:29:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1373 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:48 dist-test-slave-cbbz krb5kdc[11780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:48 dist-test-slave-cbbz krb5kdc[11780](info): set up 2 sockets
Aug 11 14:29:48 dist-test-slave-cbbz krb5kdc[11780](info): commencing operation
krb5kdc: starting...
W20260811 14:29:49.195340 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:49 dist-test-slave-cbbz krb5kdc[11780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:49.310969 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39437
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:49.394105 11794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:49.394321 11794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:49.394380 11794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:49.395542 11794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:49.395609 11794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:49.395643 11794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:49.395689 11794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:49.395720 11794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:49.397223 11794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:49.397500 11794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:49.397716 11794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:49.402547 11799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:49.402549 11800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:49.402575 11794 server_base.cc:1034] running on GCE node
W20260811 14:29:49.402478 11803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:49.402940 11794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:49.403244 11794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:49.404408 11794 hybrid_clock.cc:648] HybridClock initialized: now 1786458589404405 us; error 40 us; skew 500 ppm
Aug 11 14:29:49 dist-test-slave-cbbz krb5kdc[11780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458589, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:49.406801 11794 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:49.407215 11794 webserver.cc:460] Webserver started at http://127.0.0.1:46175/ using document root <none> and password file <none>
I20260811 14:29:49.407428 11794 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:49.407496 11794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:49.407644 11794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:49.408778 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "8eed8cdbdc4d4651a049264212b4c225"
format_stamp: "Formatted at 2026-08-11 14:29:49 on dist-test-slave-cbbz"
server_key: "6db1fbbeef92e7e0288f14eaeb7ac406"
server_key_iv: "28f66a3a9fb24afdcde70c5649b4ee9d"
server_key_version: "encryptionkey@0"
I20260811 14:29:49.409130 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "8eed8cdbdc4d4651a049264212b4c225"
format_stamp: "Formatted at 2026-08-11 14:29:49 on dist-test-slave-cbbz"
server_key: "6db1fbbeef92e7e0288f14eaeb7ac406"
server_key_iv: "28f66a3a9fb24afdcde70c5649b4ee9d"
server_key_version: "encryptionkey@0"
I20260811 14:29:49.410444 11794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:29:49.411242 11814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:49.411440 11794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:29:49.411545 11794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "8eed8cdbdc4d4651a049264212b4c225"
format_stamp: "Formatted at 2026-08-11 14:29:49 on dist-test-slave-cbbz"
server_key: "6db1fbbeef92e7e0288f14eaeb7ac406"
server_key_iv: "28f66a3a9fb24afdcde70c5649b4ee9d"
server_key_version: "encryptionkey@0"
I20260811 14:29:49.411617 11794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:49.414968 11794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:49.417021 11794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:49.417177 11794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:49.421247 11794 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39437
I20260811 14:29:49.421283 11872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39437 every 8 connection(s)
I20260811 14:29:49.421614 11794 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:49.422612 11873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:49.424857 11873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225: Bootstrap starting.
I20260811 14:29:49.425364 11873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:49.425598 11873 log.cc:824] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:49.425913 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11794
I20260811 14:29:49.426035 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:49.426231 21011 external_mini_cluster.cc:1428] Setting key 479bd194c5b8cdca02a53ec0c150ee2c
I20260811 14:29:49.426326 11873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225: No bootstrap required, opened a new log
I20260811 14:29:49.428804 11873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eed8cdbdc4d4651a049264212b4c225" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39437 } }
I20260811 14:29:49.428957 11873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:49.428982 11873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eed8cdbdc4d4651a049264212b4c225, State: Initialized, Role: FOLLOWER
I20260811 14:29:49.429106 11873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eed8cdbdc4d4651a049264212b4c225" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39437 } }
I20260811 14:29:49.429198 11873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:49.429221 11879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:49.426759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57561 (local address 127.0.0.1:39437)
0811 14:29:49.426921 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:49.426930 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:49.426963 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:29:49.427608 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:49.427615 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:49.427645 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:49.427766 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:49.428526 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:49.428529 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:49.428530 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:49.428533 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:49.428572 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:49.428582 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:49.428641 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:49.428732 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 14:29:49.428762 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260811 14:29:49.429221 11873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:49.429333 11873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:49.430058 11873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eed8cdbdc4d4651a049264212b4c225" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39437 } }
I20260811 14:29:49.430169 11873 leader_election.cc:302] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eed8cdbdc4d4651a049264212b4c225; no voters:
I20260811 14:29:49.430264 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:49.430325 11873 leader_election.cc:288] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:49.430348 11880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:49.430467 11880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [term 1 LEADER]: Becoming Leader. State: Replica: 8eed8cdbdc4d4651a049264212b4c225, State: Running, Role: LEADER
I20260811 14:29:49.430564 11880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eed8cdbdc4d4651a049264212b4c225" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39437 } }
I20260811 14:29:49.430573 11873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:49.432533 11882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8eed8cdbdc4d4651a049264212b4c225" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eed8cdbdc4d4651a049264212b4c225" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39437 } } }
I20260811 14:29:49.432629 11882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:49.432737 11883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8eed8cdbdc4d4651a049264212b4c225. Latest consensus state: current_term: 1 leader_uuid: "8eed8cdbdc4d4651a049264212b4c225" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eed8cdbdc4d4651a049264212b4c225" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39437 } } }
I20260811 14:29:49.432826 11883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:49.432957 11903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:49.433137 11879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:49.431770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60579 (local address 127.0.0.1:39437)
0811 14:29:49.431812 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:49.431814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:49.432035 (+ 221us) server_negotiation.cc:407] Connection header received
0811 14:29:49.432111 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:49.432112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:49.432116 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:49.432202 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:49.432871 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:49.432873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:49.432873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:49.432878 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:49.432891 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:49.432895 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:49.432925 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:49.433063 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 14:29:49.433077 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:29:49.433593 11903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:49.435058 11903 catalog_manager.cc:1347] Generated new cluster ID: 21047dc4be644504966f85f77cb33b7a
I20260811 14:29:49.435111 11903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:49.441888 11903 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:49.442081 11903 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:49.447069 11903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8eed8cdbdc4d4651a049264212b4c225: Generated new TSK 0
I20260811 14:29:49.447249 11903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:49.452798 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11794
2026-08-11T14:29:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:49 dist-test-slave-cbbz krb5kdc[11910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:49 dist-test-slave-cbbz krb5kdc[11910](info): set up 2 sockets
Aug 11 14:29:49 dist-test-slave-cbbz krb5kdc[11910](info): commencing operation
krb5kdc: starting...
W20260811 14:29:50.557257 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:50 dist-test-slave-cbbz krb5kdc[11910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:50.679450 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:50.760006 11923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:50.760249 11923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:50.760274 11923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:50.761363 11923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:50.761397 11923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:50.761412 11923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:50.761425 11923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:50.761437 11923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:50.762843 11923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:50.763033 11923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:50.763209 11923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:50.768045 11931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:50.768107 11928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:50.768046 11929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:50.768229 11923 server_base.cc:1034] running on GCE node
I20260811 14:29:50.768611 11923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:50.768913 11923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:50.770084 11923 hybrid_clock.cc:648] HybridClock initialized: now 1786458590770074 us; error 39 us; skew 500 ppm
Aug 11 14:29:50 dist-test-slave-cbbz krb5kdc[11910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458590, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:50.772538 11923 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:50.773023 11923 webserver.cc:460] Webserver started at http://127.0.0.1:37157/ using document root <none> and password file <none>
I20260811 14:29:50.773279 11923 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:50.773344 11923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:50.773518 11923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:50.774544 11923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "e3f4bb86cf694122b158ec0bb2f92a9a"
format_stamp: "Formatted at 2026-08-11 14:29:50 on dist-test-slave-cbbz"
server_key: "a7e66065e03972ea9a7a8500490c5136"
server_key_iv: "de3123e991029372003aa33d806af6a9"
server_key_version: "encryptionkey@0"
I20260811 14:29:50.774909 11923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "e3f4bb86cf694122b158ec0bb2f92a9a"
format_stamp: "Formatted at 2026-08-11 14:29:50 on dist-test-slave-cbbz"
server_key: "a7e66065e03972ea9a7a8500490c5136"
server_key_iv: "de3123e991029372003aa33d806af6a9"
server_key_version: "encryptionkey@0"
I20260811 14:29:50.776283 11923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:29:50.776999 11938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:50.777185 11923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:29:50.777274 11923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "e3f4bb86cf694122b158ec0bb2f92a9a"
format_stamp: "Formatted at 2026-08-11 14:29:50 on dist-test-slave-cbbz"
server_key: "a7e66065e03972ea9a7a8500490c5136"
server_key_iv: "de3123e991029372003aa33d806af6a9"
server_key_version: "encryptionkey@0"
I20260811 14:29:50.777362 11923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:50.804376 11923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:50.806427 11923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:50.806595 11923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:50.810797 11923 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40467
I20260811 14:29:50.810835 11995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40467 every 8 connection(s)
I20260811 14:29:50.811229 11923 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:50.812083 11996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:50.814280 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 11923
I20260811 14:29:50.814394 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:50.814524 11996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a: Bootstrap starting.
I20260811 14:29:50.814658 21011 external_mini_cluster.cc:1428] Setting key 8dcc4a4fca1358c0b050af2a63267b1c
I20260811 14:29:50.815335 11996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:50.815680 11996 log.cc:824] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:50.816479 11996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a: No bootstrap required, opened a new log
I20260811 14:29:50.818825 11996 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40467 } }
I20260811 14:29:50.818955 11996 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:50.818977 11996 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f4bb86cf694122b158ec0bb2f92a9a, State: Initialized, Role: FOLLOWER
I20260811 14:29:50.819105 11996 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40467 } }
I20260811 14:29:50.819185 11996 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:50.819227 11996 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:50.819275 11996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:50.819957 11996 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40467 } }
I20260811 14:29:50.820063 11996 leader_election.cc:302] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3f4bb86cf694122b158ec0bb2f92a9a; no voters:
I20260811 14:29:50.820266 11996 leader_election.cc:288] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:50.820324 12001 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:50.820547 12001 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [term 1 LEADER]: Becoming Leader. State: Replica: e3f4bb86cf694122b158ec0bb2f92a9a, State: Running, Role: LEADER
I20260811 14:29:50.820616 11996 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:50.820686 12001 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40467 } }
I20260811 14:29:50.821081 12001 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f4bb86cf694122b158ec0bb2f92a9a. Latest consensus state: current_term: 1 leader_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40467 } } }
I20260811 14:29:50.821090 12003 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f4bb86cf694122b158ec0bb2f92a9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40467 } } }
I20260811 14:29:50.821244 12001 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:50.821346 12003 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:50.821578 12012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:50.822170 12012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 14:29:50 dist-test-slave-cbbz krb5kdc[11910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 14:29:50.823846 12012 catalog_manager.cc:1347] Generated new cluster ID: f1c2644299fb447ba68030ebbf32e5a5
I20260811 14:29:50.823901 12012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:50.826910 11999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:50.815335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:42379 (local address 127.0.0.1:40467)
0811 14:29:50.815553 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:50.815562 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:50.815598 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:29:50.816188 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:50.816196 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:50.816265 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:50.816406 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:50.817086 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:50.818558 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:50.819542 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:50.820224 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:50.820341 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:50.823583 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:50.823587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:50.823588 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:50.823599 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:50.825337 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:50.825728 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:50.825731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:50.825731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:50.825823 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:50.826054 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:50.826055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:50.826055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:50.826290 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:50.826464 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:50.826594 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 14:29:50.826707 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":78,"threads_started":1}
I20260811 14:29:50.827828 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:50.838202 11999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:50.829221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:52295 (local address 127.0.0.1:40467)
0811 14:29:50.829257 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:50.829259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:50.832341 (+ 3082us) server_negotiation.cc:407] Connection header received
0811 14:29:50.832415 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:50.832416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:50.832428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:50.832488 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:50.832992 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:50.833489 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:50.834185 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:50.834394 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:50.834474 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:50.835624 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:50.835626 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:50.835626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:50.835633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:50.837041 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:50.837409 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:50.837411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:50.837411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:50.837466 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:50.837694 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:50.837695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:50.837695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:50.837805 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:50.837914 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:50.838043 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 14:29:50.838106 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:29:50.842239 12012 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:50.842919 12012 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:50.846858 12012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3f4bb86cf694122b158ec0bb2f92a9a: Generated new TSK 0
I20260811 14:29:50.847075 12012 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:50.855149 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 11923
W20260811 14:29:50.861325 11908 connection.cc:535] client connection to 127.0.0.1:40467 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40467): Connection reset by peer (error 104)
2026-08-11T14:29:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:50 dist-test-slave-cbbz krb5kdc[12029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:50 dist-test-slave-cbbz krb5kdc[12029](info): set up 2 sockets
Aug 11 14:29:50 dist-test-slave-cbbz krb5kdc[12029](info): commencing operation
krb5kdc: starting...
W20260811 14:29:51.941969 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:52 dist-test-slave-cbbz krb5kdc[12029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:52.063871 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41409
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:52.145074 12044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:52.145270 12044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:52.145293 12044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:52.146344 12044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:52.146379 12044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:52.146395 12044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:52.146407 12044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:52.146420 12044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:52.147784 12044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:52.147965 12044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:52.148128 12044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:52.152870 12049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:52.152894 12050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:52.152880 12052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:52.153688 12044 server_base.cc:1034] running on GCE node
I20260811 14:29:52.153952 12044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:52.154249 12044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:52.155421 12044 hybrid_clock.cc:648] HybridClock initialized: now 1786458592155409 us; error 42 us; skew 500 ppm
Aug 11 14:29:52 dist-test-slave-cbbz krb5kdc[12029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458592, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:52.162528 12044 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:52.163210 12044 webserver.cc:460] Webserver started at http://127.0.0.1:44467/ using document root <none> and password file <none>
I20260811 14:29:52.163522 12044 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:52.163586 12044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:52.163738 12044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:52.165231 12044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "78bc7c7d3d824b5bb2dff71e88f85e34"
format_stamp: "Formatted at 2026-08-11 14:29:52 on dist-test-slave-cbbz"
server_key: "2a524f05d787324b8e40fb7881232268"
server_key_iv: "76821e94d2e507db5fbcfb3e485ae319"
server_key_version: "encryptionkey@0"
I20260811 14:29:52.165697 12044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "78bc7c7d3d824b5bb2dff71e88f85e34"
format_stamp: "Formatted at 2026-08-11 14:29:52 on dist-test-slave-cbbz"
server_key: "2a524f05d787324b8e40fb7881232268"
server_key_iv: "76821e94d2e507db5fbcfb3e485ae319"
server_key_version: "encryptionkey@0"
I20260811 14:29:52.167761 12044 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:29:52.168723 12059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:52.168892 12044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:52.168980 12044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "78bc7c7d3d824b5bb2dff71e88f85e34"
format_stamp: "Formatted at 2026-08-11 14:29:52 on dist-test-slave-cbbz"
server_key: "2a524f05d787324b8e40fb7881232268"
server_key_iv: "76821e94d2e507db5fbcfb3e485ae319"
server_key_version: "encryptionkey@0"
I20260811 14:29:52.169052 12044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:52.195400 12044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:52.197913 12044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:52.198096 12044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:52.203174 12044 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41409
I20260811 14:29:52.203245 12118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41409 every 8 connection(s)
I20260811 14:29:52.203596 12044 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:52.204737 12120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:52.208472 12120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34: Bootstrap starting.
I20260811 14:29:52.208761 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12044
I20260811 14:29:52.208890 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:52.209151 21011 external_mini_cluster.cc:1428] Setting key 0078652ffdad1861a46ad152ab090842
I20260811 14:29:52.209312 12120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:52.209815 12120 log.cc:824] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:52.210747 12120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34: No bootstrap required, opened a new log
I20260811 14:29:52.212663 12120 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41409 } }
I20260811 14:29:52.212828 12120 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:52.212875 12120 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bc7c7d3d824b5bb2dff71e88f85e34, State: Initialized, Role: FOLLOWER
I20260811 14:29:52.213004 12120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41409 } }
I20260811 14:29:52.213088 12120 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:52.213117 12120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:52.213158 12120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:52.213837 12120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41409 } }
I20260811 14:29:52.213984 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78bc7c7d3d824b5bb2dff71e88f85e34; no voters:
I20260811 14:29:52.214159 12120 leader_election.cc:288] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:52.214190 12125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:52.214354 12125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [term 1 LEADER]: Becoming Leader. State: Replica: 78bc7c7d3d824b5bb2dff71e88f85e34, State: Running, Role: LEADER
I20260811 14:29:52.214427 12120 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:52.214448 12125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41409 } }
I20260811 14:29:52.215162 12127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78bc7c7d3d824b5bb2dff71e88f85e34. Latest consensus state: current_term: 1 leader_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41409 } } }
I20260811 14:29:52.215246 12127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:52.215765 12134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:52.215844 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:52.209900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:58299 (local address 127.0.0.1:41409)
0811 14:29:52.210115 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:52.210124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:52.210158 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:29:52.210666 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:52.210674 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:52.210724 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:52.210939 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:52.211207 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:52.212131 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:52.213009 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:52.213649 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:52.213786 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:52.214854 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:52.214859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:52.214859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:52.215076 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:52.215121 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:52.215138 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:52.215242 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:52.215588 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 14:29:52.215621 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":83,"threads_started":1}
I20260811 14:29:52.216277 12134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:52.216257 12126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bc7c7d3d824b5bb2dff71e88f85e34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41409 } } }
I20260811 14:29:52.216347 12126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:52.216882 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:52.217993 12134 catalog_manager.cc:1347] Generated new cluster ID: 071c39545a8c4dd5aa4269c22f72540f
I20260811 14:29:52.218046 12134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:52.222977 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:52.218539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:53457 (local address 127.0.0.1:41409)
0811 14:29:52.218574 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:52.218576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:52.220298 (+ 1722us) server_negotiation.cc:407] Connection header received
0811 14:29:52.220362 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:52.220362 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:52.220375 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:52.220427 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:52.220598 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:52.221074 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:52.221811 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:52.222025 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:52.222099 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:52.222739 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:52.222741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:52.222741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:52.222746 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:52.222759 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:52.222763 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:52.222816 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:52.222876 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 14:29:52.222885 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:29:52.234349 12134 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:52.234911 12134 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:52.237932 12134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78bc7c7d3d824b5bb2dff71e88f85e34: Generated new TSK 0
I20260811 14:29:52.238135 12134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:52.241869 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12044
W20260811 14:29:52.249193 12027 connection.cc:535] client connection to 127.0.0.1:41409 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41409): Connection reset by peer (error 104)
2026-08-11T14:29:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1387 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:52 dist-test-slave-cbbz krb5kdc[12152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:52 dist-test-slave-cbbz krb5kdc[12152](info): set up 2 sockets
Aug 11 14:29:52 dist-test-slave-cbbz krb5kdc[12152](info): commencing operation
krb5kdc: starting...
W20260811 14:29:53.340342 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:53 dist-test-slave-cbbz krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:53.458954 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38053
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:53.540629 12166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:53.540848 12166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:53.540871 12166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:53.542196 12166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:53.542243 12166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:53.542258 12166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:53.542270 12166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:53.542284 12166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:53.543913 12166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:53.544201 12166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:53.544440 12166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:53.549295 12172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:53.549306 12173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:53.549317 12175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:53.549613 12166 server_base.cc:1034] running on GCE node
I20260811 14:29:53.549873 12166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:53.550144 12166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:53.551303 12166 hybrid_clock.cc:648] HybridClock initialized: now 1786458593551288 us; error 29 us; skew 500 ppm
Aug 11 14:29:53 dist-test-slave-cbbz krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458593, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:53.554167 12166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:53.554647 12166 webserver.cc:460] Webserver started at http://127.0.0.1:46455/ using document root <none> and password file <none>
I20260811 14:29:53.554891 12166 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:53.554944 12166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:53.555133 12166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:53.556391 12166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "5678a603ba94490584c914f83aa0291f"
format_stamp: "Formatted at 2026-08-11 14:29:53 on dist-test-slave-cbbz"
server_key: "bbbfcdda4a2e605a084c732cb8bcee44"
server_key_iv: "ef78e8d6821c677310e1a3ae6603c468"
server_key_version: "encryptionkey@0"
I20260811 14:29:53.556787 12166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "5678a603ba94490584c914f83aa0291f"
format_stamp: "Formatted at 2026-08-11 14:29:53 on dist-test-slave-cbbz"
server_key: "bbbfcdda4a2e605a084c732cb8bcee44"
server_key_iv: "ef78e8d6821c677310e1a3ae6603c468"
server_key_version: "encryptionkey@0"
I20260811 14:29:53.558231 12166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:29:53.558962 12182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:53.559140 12166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:53.559257 12166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "5678a603ba94490584c914f83aa0291f"
format_stamp: "Formatted at 2026-08-11 14:29:53 on dist-test-slave-cbbz"
server_key: "bbbfcdda4a2e605a084c732cb8bcee44"
server_key_iv: "ef78e8d6821c677310e1a3ae6603c468"
server_key_version: "encryptionkey@0"
I20260811 14:29:53.559338 12166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:53.563053 12166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:53.565563 12166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:53.565744 12166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:53.570178 12166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38053
I20260811 14:29:53.570225 12237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38053 every 8 connection(s)
I20260811 14:29:53.570550 12166 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:53.571532 12238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:53.573799 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12166
I20260811 14:29:53.573884 12238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f: Bootstrap starting.
I20260811 14:29:53.573951 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:53.574152 21011 external_mini_cluster.cc:1428] Setting key 9195e7f060044a70226659069296c46e
I20260811 14:29:53.574602 12238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:53.574962 12238 log.cc:824] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:53.575615 12238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f: No bootstrap required, opened a new log
I20260811 14:29:53.576844 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:53.574715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:53279 (local address 127.0.0.1:38053)
0811 14:29:53.574948 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:53.574959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:53.574995 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:29:53.575504 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:53.575511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:53.575537 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:53.575707 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:53.576417 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:53.576420 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:53.576421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:53.576426 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:53.576472 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:53.576483 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:53.576586 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:53.576624 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 14:29:53.576670 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260811 14:29:53.577912 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:53.578078 12238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5678a603ba94490584c914f83aa0291f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38053 } }
I20260811 14:29:53.578225 12238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:53.578272 12238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5678a603ba94490584c914f83aa0291f, State: Initialized, Role: FOLLOWER
I20260811 14:29:53.578392 12238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5678a603ba94490584c914f83aa0291f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38053 } }
I20260811 14:29:53.578498 12238 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:53.578547 12238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:53.578596 12238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:53.579167 12238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5678a603ba94490584c914f83aa0291f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38053 } }
I20260811 14:29:53.579283 12238 leader_election.cc:302] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5678a603ba94490584c914f83aa0291f; no voters:
I20260811 14:29:53.579456 12238 leader_election.cc:288] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:53.579608 12250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:53.579712 12238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:53.579737 12250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [term 1 LEADER]: Becoming Leader. State: Replica: 5678a603ba94490584c914f83aa0291f, State: Running, Role: LEADER
I20260811 14:29:53.579936 12250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5678a603ba94490584c914f83aa0291f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38053 } }
I20260811 14:29:53.580632 12251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5678a603ba94490584c914f83aa0291f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5678a603ba94490584c914f83aa0291f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38053 } } }
I20260811 14:29:53.580765 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:53.579463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:36123 (local address 127.0.0.1:38053)
0811 14:29:53.579562 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:53.579564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:53.579617 (+ 53us) server_negotiation.cc:407] Connection header received
0811 14:29:53.579726 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:53.579727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:53.579732 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:53.579768 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:53.580461 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:53.580462 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:53.580463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:53.580467 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:53.580481 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:53.580486 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:53.580521 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:53.580662 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 14:29:53.580677 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 14:29:53.580775 12251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [sys.catalog]: This master's current role is: LEADER
W20260811 14:29:53.581653 12268 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 14:29:53.580793 12250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5678a603ba94490584c914f83aa0291f. Latest consensus state: current_term: 1 leader_uuid: "5678a603ba94490584c914f83aa0291f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5678a603ba94490584c914f83aa0291f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38053 } } }
W20260811 14:29:53.581759 12268 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:29:53.581799 12250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:53.581841 12271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:53.581985 12271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:53.583412 12271 catalog_manager.cc:1347] Generated new cluster ID: a334be46454f4e1d967929e86ece7a44
I20260811 14:29:53.583467 12271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:53.595816 12271 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:53.595999 12271 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:53.600512 12271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5678a603ba94490584c914f83aa0291f: Generated new TSK 0
I20260811 14:29:53.600693 12271 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:53.605791 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12166
2026-08-11T14:29:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1363 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:53 dist-test-slave-cbbz krb5kdc[12278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:53 dist-test-slave-cbbz krb5kdc[12278](info): set up 2 sockets
Aug 11 14:29:53 dist-test-slave-cbbz krb5kdc[12278](info): commencing operation
krb5kdc: starting...
W20260811 14:29:54.702425 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:54 dist-test-slave-cbbz krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:54.826608 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41647
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:54.907999 12292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:54.908285 12292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:54.908327 12292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:54.909482 12292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:54.909554 12292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:54.909587 12292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:54.909619 12292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:54.909642 12292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:54.911098 12292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41647
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:54.911378 12292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:54.911612 12292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:54.916728 12298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:54.916728 12297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:54.916872 12292 server_base.cc:1034] running on GCE node
W20260811 14:29:54.916942 12300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:54.917282 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:54.917567 12292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:54.918745 12292 hybrid_clock.cc:648] HybridClock initialized: now 1786458594918729 us; error 44 us; skew 500 ppm
Aug 11 14:29:54 dist-test-slave-cbbz krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458594, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:54.921416 12292 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:54.921918 12292 webserver.cc:460] Webserver started at http://127.0.0.1:40931/ using document root <none> and password file <none>
I20260811 14:29:54.922153 12292 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:54.922223 12292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:54.922380 12292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:54.923488 12292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "3fbbab32cc784579a36ae29041fec426"
format_stamp: "Formatted at 2026-08-11 14:29:54 on dist-test-slave-cbbz"
server_key: "510a6245cfef4a99a52315623e99a7b1"
server_key_iv: "b1fcb74ab1bbfe57dccb419490a3b51f"
server_key_version: "encryptionkey@0"
I20260811 14:29:54.923862 12292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "3fbbab32cc784579a36ae29041fec426"
format_stamp: "Formatted at 2026-08-11 14:29:54 on dist-test-slave-cbbz"
server_key: "510a6245cfef4a99a52315623e99a7b1"
server_key_iv: "b1fcb74ab1bbfe57dccb419490a3b51f"
server_key_version: "encryptionkey@0"
I20260811 14:29:54.925257 12292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:29:54.926029 12308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:54.926254 12292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 14:29:54.926362 12292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "3fbbab32cc784579a36ae29041fec426"
format_stamp: "Formatted at 2026-08-11 14:29:54 on dist-test-slave-cbbz"
server_key: "510a6245cfef4a99a52315623e99a7b1"
server_key_iv: "b1fcb74ab1bbfe57dccb419490a3b51f"
server_key_version: "encryptionkey@0"
I20260811 14:29:54.926437 12292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:54.944288 12292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:54.946683 12292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:54.946851 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:54.951030 12292 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41647
I20260811 14:29:54.951067 12368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41647 every 8 connection(s)
I20260811 14:29:54.951431 12292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:54.952319 12369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:54.954622 12369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426: Bootstrap starting.
I20260811 14:29:54.955240 12369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:54.955533 12369 log.cc:824] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:54.956256 12369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426: No bootstrap required, opened a new log
I20260811 14:29:54.957839 12369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fbbab32cc784579a36ae29041fec426" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41647 } }
I20260811 14:29:54.957973 12369 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:54.957995 12369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fbbab32cc784579a36ae29041fec426, State: Initialized, Role: FOLLOWER
I20260811 14:29:54.958186 12369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fbbab32cc784579a36ae29041fec426" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41647 } }
I20260811 14:29:54.958253 12369 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:54.958274 12369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:54.958334 12369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:54.958887 12369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fbbab32cc784579a36ae29041fec426" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41647 } }
I20260811 14:29:54.958994 12369 leader_election.cc:302] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fbbab32cc784579a36ae29041fec426; no voters:
I20260811 14:29:54.959170 12369 leader_election.cc:288] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:54.959229 12372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:54.959406 12372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [term 1 LEADER]: Becoming Leader. State: Replica: 3fbbab32cc784579a36ae29041fec426, State: Running, Role: LEADER
I20260811 14:29:54.959426 12369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:54.959582 12372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fbbab32cc784579a36ae29041fec426" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41647 } }
I20260811 14:29:54.959964 12375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fbbab32cc784579a36ae29041fec426. Latest consensus state: current_term: 1 leader_uuid: "3fbbab32cc784579a36ae29041fec426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fbbab32cc784579a36ae29041fec426" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41647 } } }
I20260811 14:29:54.960115 12375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:54.960100 12374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fbbab32cc784579a36ae29041fec426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fbbab32cc784579a36ae29041fec426" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41647 } } }
I20260811 14:29:54.960220 12374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:54.960713 12383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:54.961230 12383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:54.961625 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12292
I20260811 14:29:54.961760 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:54.961992 21011 external_mini_cluster.cc:1428] Setting key 7b20486fe5c560b38f093f4814b38d9b
I20260811 14:29:54.963629 12383 catalog_manager.cc:1347] Generated new cluster ID: c7d3b55b18174a7291539f2ea633e51f
I20260811 14:29:54.963686 12383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:54.979674 12383 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:54.980464 12383 catalog_manager.cc:1504] Loading token signing keys...
Aug 11 14:29:54 dist-test-slave-cbbz krb5kdc[12278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 14:29:54.985749 12383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fbbab32cc784579a36ae29041fec426: Generated new TSK 0
I20260811 14:29:54.985942 12383 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:54.986790 12392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:54.962471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:41863 (local address 127.0.0.1:41647)
0811 14:29:54.962689 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:54.962699 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:54.962734 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:29:54.962844 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:54.962851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:54.962907 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:54.963048 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:54.976639 (+ 13591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:54.978092 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:54.979258 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:54.979845 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:54.979954 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:54.982509 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:54.982513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:54.982513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:54.982529 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:54.984829 (+ 2300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:54.985243 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:54.985247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:54.985247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:54.985351 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:54.985686 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:54.985687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:54.985688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:54.985984 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:54.986171 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:54.986437 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 14:29:54.986542 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":120,"threads_started":1}
I20260811 14:29:54.987841 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:54.996423 12392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:54.989434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:59001 (local address 127.0.0.1:41647)
0811 14:29:54.989494 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:54.989495 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:54.989632 (+ 137us) server_negotiation.cc:407] Connection header received
0811 14:29:54.989689 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:54.989690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:54.989699 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:54.989744 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:54.990396 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:54.990870 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:54.991968 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:54.992254 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:54.992319 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:54.993691 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:54.993692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:54.993692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:54.993698 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:54.995091 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:54.995535 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:54.995536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:54.995536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:54.995586 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:54.995822 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:54.995823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:54.995823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:54.995918 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:54.996005 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:54.996240 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 14:29:54.996290 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:29:54.998359 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12292
W20260811 14:29:55.005738 12273 connection.cc:535] client connection to 127.0.0.1:41647 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41647): Connection reset by peer (error 104)
2026-08-11T14:29:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:55 dist-test-slave-cbbz krb5kdc[12404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:55 dist-test-slave-cbbz krb5kdc[12404](info): set up 2 sockets
Aug 11 14:29:55 dist-test-slave-cbbz krb5kdc[12404](info): commencing operation
krb5kdc: starting...
W20260811 14:29:56.099982 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:56 dist-test-slave-cbbz krb5kdc[12404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:56.220806 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:56.302192 12418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:56.302417 12418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:56.302454 12418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:56.303568 12418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:56.303638 12418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:56.303665 12418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:56.303697 12418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:56.303723 12418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:56.305212 12418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42737
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:56.305476 12418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:56.305696 12418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:56.310505 12424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:56.310469 12426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:56.310793 12418 server_base.cc:1034] running on GCE node
W20260811 14:29:56.310508 12423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:56.311121 12418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:56.311420 12418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:56.312558 12418 hybrid_clock.cc:648] HybridClock initialized: now 1786458596312546 us; error 30 us; skew 500 ppm
Aug 11 14:29:56 dist-test-slave-cbbz krb5kdc[12404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458596, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:56.315030 12418 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:56.315392 12418 webserver.cc:460] Webserver started at http://127.0.0.1:43387/ using document root <none> and password file <none>
I20260811 14:29:56.315555 12418 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:56.315594 12418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:56.315683 12418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:56.316702 12418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4"
format_stamp: "Formatted at 2026-08-11 14:29:56 on dist-test-slave-cbbz"
server_key: "ceb5bb6e1e90dd172f9eea5d2d2caa2a"
server_key_iv: "742ef710fe0b4f5a222a1042756edbd6"
server_key_version: "encryptionkey@0"
I20260811 14:29:56.316993 12418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4"
format_stamp: "Formatted at 2026-08-11 14:29:56 on dist-test-slave-cbbz"
server_key: "ceb5bb6e1e90dd172f9eea5d2d2caa2a"
server_key_iv: "742ef710fe0b4f5a222a1042756edbd6"
server_key_version: "encryptionkey@0"
I20260811 14:29:56.318236 12418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:29:56.318903 12433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:56.319070 12418 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:56.319169 12418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4"
format_stamp: "Formatted at 2026-08-11 14:29:56 on dist-test-slave-cbbz"
server_key: "ceb5bb6e1e90dd172f9eea5d2d2caa2a"
server_key_iv: "742ef710fe0b4f5a222a1042756edbd6"
server_key_version: "encryptionkey@0"
I20260811 14:29:56.319247 12418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:56.330991 12418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:56.333184 12418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:56.333340 12418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:56.337265 12418 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42737
I20260811 14:29:56.337296 12493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42737 every 8 connection(s)
I20260811 14:29:56.337621 12418 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:56.338478 12494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:56.340706 12494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4: Bootstrap starting.
I20260811 14:29:56.341274 12494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:56.341575 12494 log.cc:824] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:56.342265 12494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4: No bootstrap required, opened a new log
I20260811 14:29:56.343811 12494 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 14:29:56.343942 12494 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:56.343964 12494 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8b5ddc5b4f241858a4750e34ac9b5d4, State: Initialized, Role: FOLLOWER
I20260811 14:29:56.344152 12494 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 14:29:56.344218 12494 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:56.344261 12494 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:56.344310 12494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:56.344839 12494 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 14:29:56.344949 12494 leader_election.cc:302] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8b5ddc5b4f241858a4750e34ac9b5d4; no voters:
I20260811 14:29:56.345130 12494 leader_election.cc:288] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:56.345180 12497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:56.345342 12497 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [term 1 LEADER]: Becoming Leader. State: Replica: f8b5ddc5b4f241858a4750e34ac9b5d4, State: Running, Role: LEADER
I20260811 14:29:56.345494 12497 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 14:29:56.345525 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12418
I20260811 14:29:56.345645 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:56.345886 21011 external_mini_cluster.cc:1428] Setting key e49f914434baf73d05b4c07707068000
I20260811 14:29:56.345921 12499 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } } }
I20260811 14:29:56.346000 12499 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:56.346064 12500 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8b5ddc5b4f241858a4750e34ac9b5d4. Latest consensus state: current_term: 1 leader_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b5ddc5b4f241858a4750e34ac9b5d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } } }
I20260811 14:29:56.346129 12500 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:56.346300 12494 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:56.346670 12503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:56.347222 12503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:56.348805 12503 catalog_manager.cc:1347] Generated new cluster ID: f250992b95714d89bd5fb738e870aca4
I20260811 14:29:56.348860 12503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:56.352336 12505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:56.346359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:54263 (local address 127.0.0.1:42737)
0811 14:29:56.347772 (+ 1413us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:56.347781 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:56.347899 (+ 118us) server_negotiation.cc:407] Connection header received
0811 14:29:56.348017 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:56.348024 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:56.348084 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:56.348287 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:56.348561 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:56.349573 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:56.350391 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:56.350808 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:56.350939 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:56.351677 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:56.351681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:56.351682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:56.351854 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:56.351884 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:56.351895 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:56.351991 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:56.352074 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 14:29:56.352102 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":232,"thread_start_us":78,"threads_started":1}
I20260811 14:29:56.353291 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:56.363138 12505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:56.356467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:54943 (local address 127.0.0.1:42737)
0811 14:29:56.356508 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:56.356510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:56.360327 (+ 3817us) server_negotiation.cc:407] Connection header received
0811 14:29:56.360400 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:56.360401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:56.360412 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:56.360489 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:56.360626 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:56.361132 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:56.361849 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:56.362067 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:56.362204 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:56.362867 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:56.362869 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:56.362869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:56.362873 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:56.362887 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:56.362891 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:56.362961 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:56.363024 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 14:29:56.363035 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:29:56.371611 12503 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:56.372305 12503 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:56.375236 12503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8b5ddc5b4f241858a4750e34ac9b5d4: Generated new TSK 0
I20260811 14:29:56.375394 12503 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:56.381093 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12418
W20260811 14:29:56.387266 12401 connection.cc:535] client connection to 127.0.0.1:42737 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42737): Connection reset by peer (error 104)
2026-08-11T14:29:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1381 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:56 dist-test-slave-cbbz krb5kdc[12530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:56 dist-test-slave-cbbz krb5kdc[12530](info): set up 2 sockets
Aug 11 14:29:56 dist-test-slave-cbbz krb5kdc[12530](info): commencing operation
krb5kdc: starting...
W20260811 14:29:57.510589 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:57 dist-test-slave-cbbz krb5kdc[12530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 14:29:57.630586 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34419
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:57.713074 12544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:57.713281 12544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:57.713304 12544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:57.714455 12544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:57.714498 12544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:57.714512 12544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:57.714525 12544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:57.714582 12544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:57.716118 12544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34419
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:57.716384 12544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:57.716617 12544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:57.721509 12553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:57.721481 12549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:57.721493 12550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:57.721814 12544 server_base.cc:1034] running on GCE node
I20260811 14:29:57.722056 12544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:57.722354 12544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:57.723497 12544 hybrid_clock.cc:648] HybridClock initialized: now 1786458597723489 us; error 33 us; skew 500 ppm
Aug 11 14:29:57 dist-test-slave-cbbz krb5kdc[12530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458597, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:57.730983 12544 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 14:29:57.731499 12544 webserver.cc:460] Webserver started at http://127.0.0.1:37855/ using document root <none> and password file <none>
I20260811 14:29:57.731731 12544 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:57.731801 12544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:57.731962 12544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:57.733093 12544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "f7c3264ea8224d2599e27629672c1a0e"
format_stamp: "Formatted at 2026-08-11 14:29:57 on dist-test-slave-cbbz"
server_key: "7928e7f791830abd90ed93b425e56b1d"
server_key_iv: "6bc84eff156a678a4b3ed3931c07aeee"
server_key_version: "encryptionkey@0"
I20260811 14:29:57.733475 12544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "f7c3264ea8224d2599e27629672c1a0e"
format_stamp: "Formatted at 2026-08-11 14:29:57 on dist-test-slave-cbbz"
server_key: "7928e7f791830abd90ed93b425e56b1d"
server_key_iv: "6bc84eff156a678a4b3ed3931c07aeee"
server_key_version: "encryptionkey@0"
I20260811 14:29:57.734896 12544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:29:57.735659 12562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:57.735837 12544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:57.735936 12544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "f7c3264ea8224d2599e27629672c1a0e"
format_stamp: "Formatted at 2026-08-11 14:29:57 on dist-test-slave-cbbz"
server_key: "7928e7f791830abd90ed93b425e56b1d"
server_key_iv: "6bc84eff156a678a4b3ed3931c07aeee"
server_key_version: "encryptionkey@0"
I20260811 14:29:57.736022 12544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:57.739339 12544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:57.741472 12544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:57.741631 12544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:57.745864 12544 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34419
I20260811 14:29:57.745893 12620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34419 every 8 connection(s)
I20260811 14:29:57.746227 12544 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:57.747167 12621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:57.749424 12621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e: Bootstrap starting.
I20260811 14:29:57.749965 12621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:57.750229 12621 log.cc:824] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:57.750866 12621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e: No bootstrap required, opened a new log
I20260811 14:29:57.752470 12621 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c3264ea8224d2599e27629672c1a0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34419 } }
I20260811 14:29:57.752609 12621 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:57.752632 12621 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c3264ea8224d2599e27629672c1a0e, State: Initialized, Role: FOLLOWER
I20260811 14:29:57.752769 12621 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c3264ea8224d2599e27629672c1a0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34419 } }
I20260811 14:29:57.752852 12621 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:57.752875 12621 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:57.752903 12621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:57.753392 12621 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c3264ea8224d2599e27629672c1a0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34419 } }
I20260811 14:29:57.753475 12621 leader_election.cc:302] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7c3264ea8224d2599e27629672c1a0e; no voters:
I20260811 14:29:57.753602 12621 leader_election.cc:288] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:57.753659 12624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:57.753824 12624 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [term 1 LEADER]: Becoming Leader. State: Replica: f7c3264ea8224d2599e27629672c1a0e, State: Running, Role: LEADER
I20260811 14:29:57.753887 12621 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:57.753959 12624 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c3264ea8224d2599e27629672c1a0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34419 } }
I20260811 14:29:57.754386 12626 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7c3264ea8224d2599e27629672c1a0e. Latest consensus state: current_term: 1 leader_uuid: "f7c3264ea8224d2599e27629672c1a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c3264ea8224d2599e27629672c1a0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34419 } } }
I20260811 14:29:57.754526 12626 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:57.754514 12625 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7c3264ea8224d2599e27629672c1a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7c3264ea8224d2599e27629672c1a0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34419 } } }
I20260811 14:29:57.754632 12625 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:57.754921 12633 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:57.755419 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12544
I20260811 14:29:57.755504 12633 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:57.755558 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:57.755766 21011 external_mini_cluster.cc:1428] Setting key 5302cdddbba92097bac7b99e0fcf4137
I20260811 14:29:57.757325 12633 catalog_manager.cc:1347] Generated new cluster ID: 35964fbbb64d4a84969b49315621bb0c
I20260811 14:29:57.757380 12633 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:29:57.761999 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:57.756240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:56597 (local address 127.0.0.1:34419)
0811 14:29:57.760264 (+ 4024us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:57.760274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:57.760308 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:29:57.760416 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:57.760422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:57.760451 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:57.760585 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:57.761364 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:57.761368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:57.761368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:57.761373 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:57.761424 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:57.761439 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:57.761519 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:57.761583 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 14:29:57.761628 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3968,"thread_start_us":181,"threads_started":1}
I20260811 14:29:57.762915 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:57.768796 12633 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:57.768952 12633 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:57.772719 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:57.764480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.249:52599 (local address 127.0.0.1:34419)
0811 14:29:57.764513 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:57.764515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:57.768296 (+ 3781us) server_negotiation.cc:407] Connection header received
0811 14:29:57.768319 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:57.768319 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:57.768324 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:57.768370 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:57.772393 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:57.772395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:57.772395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:29:57.772399 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:57.772413 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:29:57.772417 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:57.772454 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:57.772640 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 14:29:57.772654 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:29:57.773699 12633 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7c3264ea8224d2599e27629672c1a0e: Generated new TSK 0
I20260811 14:29:57.773878 12633 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:57.777403 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12544
2026-08-11T14:29:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1398 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:57 dist-test-slave-cbbz krb5kdc[12656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:57 dist-test-slave-cbbz krb5kdc[12656](info): set up 2 sockets
Aug 11 14:29:57 dist-test-slave-cbbz krb5kdc[12656](info): commencing operation
krb5kdc: starting...
W20260811 14:29:58.905580 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:29:58 dist-test-slave-cbbz krb5kdc[12656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:29:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:29:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:29:59.027384 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41289
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:41289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:29:59.110183 12672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:29:59.110426 12672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:29:59.110467 12672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:29:59.111688 12672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:29:59.111754 12672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:29:59.111781 12672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:29:59.111814 12672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:29:59.111840 12672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:29:59.113368 12672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:41289
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:29:59.113643 12672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:29:59.113875 12672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:29:59.118796 12678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:59.118801 12677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:29:59.118934 12681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:29:59.119161 12672 server_base.cc:1034] running on GCE node
I20260811 14:29:59.119447 12672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:29:59.119736 12672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:29:59.120899 12672 hybrid_clock.cc:648] HybridClock initialized: now 1786458599120886 us; error 31 us; skew 500 ppm
Aug 11 14:29:59 dist-test-slave-cbbz krb5kdc[12656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458599, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:29:59.123363 12672 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:29:59.123857 12672 webserver.cc:460] Webserver started at http://127.20.132.254:34455/ using document root <none> and password file <none>
I20260811 14:29:59.124096 12672 fs_manager.cc:359] Metadata directory not provided
I20260811 14:29:59.124189 12672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:29:59.124338 12672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:29:59.125414 12672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "278c55c15de844628220f0bb3b4fbd02"
format_stamp: "Formatted at 2026-08-11 14:29:59 on dist-test-slave-cbbz"
server_key: "cc8781f796d17c43bcd5ca7549640878"
server_key_iv: "bc9711f51bc1f0730f2613762e30a321"
server_key_version: "encryptionkey@0"
I20260811 14:29:59.125795 12672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "278c55c15de844628220f0bb3b4fbd02"
format_stamp: "Formatted at 2026-08-11 14:29:59 on dist-test-slave-cbbz"
server_key: "cc8781f796d17c43bcd5ca7549640878"
server_key_iv: "bc9711f51bc1f0730f2613762e30a321"
server_key_version: "encryptionkey@0"
I20260811 14:29:59.127121 12672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:29:59.127858 12689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:29:59.128026 12672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:29:59.128170 12672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "278c55c15de844628220f0bb3b4fbd02"
format_stamp: "Formatted at 2026-08-11 14:29:59 on dist-test-slave-cbbz"
server_key: "cc8781f796d17c43bcd5ca7549640878"
server_key_iv: "bc9711f51bc1f0730f2613762e30a321"
server_key_version: "encryptionkey@0"
I20260811 14:29:59.128260 12672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:29:59.148687 12672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:29:59.150738 12672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:29:59.150906 12672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:29:59.155141 12672 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:41289
I20260811 14:29:59.155189 12743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:41289 every 8 connection(s)
I20260811 14:29:59.155582 12672 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:29:59.156558 12744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:29:59.159108 12744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02: Bootstrap starting.
I20260811 14:29:59.159752 12744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02: Neither blocks nor log segments found. Creating new log.
I20260811 14:29:59.160081 12744 log.cc:824] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02: Log is configured to *not* fsync() on all Append() calls
I20260811 14:29:59.160890 12744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02: No bootstrap required, opened a new log
I20260811 14:29:59.162627 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12672
I20260811 14:29:59.162777 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:29:59.163004 21011 external_mini_cluster.cc:1428] Setting key e6adabddbcfb566996ffe05f634e2252
I20260811 14:29:59.162895 12744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278c55c15de844628220f0bb3b4fbd02" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41289 } }
I20260811 14:29:59.163087 12744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:29:59.163141 12744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 278c55c15de844628220f0bb3b4fbd02, State: Initialized, Role: FOLLOWER
I20260811 14:29:59.163290 12744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278c55c15de844628220f0bb3b4fbd02" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41289 } }
I20260811 14:29:59.163388 12744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:29:59.163499 12744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:29:59.163573 12744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:29:59.164875 12744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278c55c15de844628220f0bb3b4fbd02" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41289 } }
I20260811 14:29:59.164995 12744 leader_election.cc:302] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 278c55c15de844628220f0bb3b4fbd02; no voters:
I20260811 14:29:59.165171 12744 leader_election.cc:288] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:29:59.165228 12749 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:29:59.165390 12749 raft_consensus.cc:686] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [term 1 LEADER]: Becoming Leader. State: Replica: 278c55c15de844628220f0bb3b4fbd02, State: Running, Role: LEADER
I20260811 14:29:59.165454 12744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:29:59.165544 12749 consensus_queue.cc:237] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278c55c15de844628220f0bb3b4fbd02" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41289 } }
I20260811 14:29:59.165944 12749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 278c55c15de844628220f0bb3b4fbd02. Latest consensus state: current_term: 1 leader_uuid: "278c55c15de844628220f0bb3b4fbd02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278c55c15de844628220f0bb3b4fbd02" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41289 } } }
I20260811 14:29:59.165954 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "278c55c15de844628220f0bb3b4fbd02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278c55c15de844628220f0bb3b4fbd02" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 41289 } } }
I20260811 14:29:59.166097 12749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:59.166105 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02 [sys.catalog]: This master's current role is: LEADER
I20260811 14:29:59.166349 12758 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:29:59.167273 12758 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:29:59.168957 12758 catalog_manager.cc:1347] Generated new cluster ID: 2e52569cf45a40929ed4bfd2c2382cae
I20260811 14:29:59.169009 12758 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:29:59 dist-test-slave-cbbz krb5kdc[12656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:29:59.175956 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:59.163559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57563 (local address 127.20.132.254:41289)
0811 14:29:59.163782 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:59.163793 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:59.163830 (+ 37us) server_negotiation.cc:407] Connection header received
0811 14:29:59.163959 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:59.163966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:59.164021 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:59.164217 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:59.164892 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:59.166319 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:59.167453 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:59.168047 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:59.168190 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:59.171326 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:59.171331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:59.171332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:59.171345 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:59.173508 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:59.174060 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:59.174063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:59.174064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:59.174188 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:59.174485 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:59.174486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:59.174486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:59.174825 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:59.175503 (+ 678us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:59.175609 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 14:29:59.175723 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":109,"threads_started":1}
I20260811 14:29:59.177486 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:29:59.182296 12758 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:29:59.182787 12758 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:29:59.187294 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:29:59.179167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39079 (local address 127.20.132.254:41289)
0811 14:29:59.179207 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:29:59.179209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:29:59.179468 (+ 259us) server_negotiation.cc:407] Connection header received
0811 14:29:59.179601 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:29:59.179602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:29:59.179613 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:29:59.179648 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:29:59.180454 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:59.181171 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:59.182222 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:29:59.182532 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:29:59.182577 (+ 45us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:29:59.184228 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:29:59.184230 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:29:59.184230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:29:59.184237 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:29:59.185830 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:59.186301 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:59.186302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:59.186303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:59.186361 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:29:59.186645 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:29:59.186646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:29:59.186646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:29:59.186779 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:29:59.186860 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 14:29:59.187130 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 14:29:59.187200 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:29:59.189445 12758 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 278c55c15de844628220f0bb3b4fbd02: Generated new TSK 0
I20260811 14:29:59.189625 12758 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:29:59.195346 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12672
W20260811 14:29:59.202854 12653 connection.cc:535] client connection to 127.20.132.254:41289 recv error: Network error: failed to read from TLS socket (remote: 127.20.132.254:41289): Connection reset by peer (error 104)
2026-08-11T14:29:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:29:59 dist-test-slave-cbbz krb5kdc[12777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:29:59 dist-test-slave-cbbz krb5kdc[12777](info): set up 2 sockets
Aug 11 14:29:59 dist-test-slave-cbbz krb5kdc[12777](info): commencing operation
krb5kdc: starting...
W20260811 14:30:00.284745 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:00 dist-test-slave-cbbz krb5kdc[12777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:00.404966 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46713
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:00.486451 12793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:00.486652 12793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:00.486675 12793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:00.487746 12793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:00.487779 12793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:00.487793 12793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:00.487805 12793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:00.487818 12793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:00.489208 12793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46713
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:00.489394 12793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:00.489553 12793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:00.494359 12802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:00.494565 12793 server_base.cc:1034] running on GCE node
W20260811 14:30:00.494454 12799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:00.494359 12798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:00.494937 12793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:00.495211 12793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:00.496356 12793 hybrid_clock.cc:648] HybridClock initialized: now 1786458600496343 us; error 30 us; skew 500 ppm
Aug 11 14:30:00 dist-test-slave-cbbz krb5kdc[12777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458600, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:00.498805 12793 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:00.499245 12793 webserver.cc:460] Webserver started at http://127.20.132.254:42059/ using document root <none> and password file <none>
I20260811 14:30:00.499419 12793 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:00.499482 12793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:00.499601 12793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:00.500627 12793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "e054a656e56044a3994585452bcf8115"
format_stamp: "Formatted at 2026-08-11 14:30:00 on dist-test-slave-cbbz"
server_key: "6929b3eba5f95a39e43e61c3d1658946"
server_key_iv: "990e76ecc48a0b051e6e199484d825a0"
server_key_version: "encryptionkey@0"
I20260811 14:30:00.500946 12793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "e054a656e56044a3994585452bcf8115"
format_stamp: "Formatted at 2026-08-11 14:30:00 on dist-test-slave-cbbz"
server_key: "6929b3eba5f95a39e43e61c3d1658946"
server_key_iv: "990e76ecc48a0b051e6e199484d825a0"
server_key_version: "encryptionkey@0"
I20260811 14:30:00.502234 12793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:30:00.502947 12813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:00.503156 12793 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:30:00.503229 12793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "e054a656e56044a3994585452bcf8115"
format_stamp: "Formatted at 2026-08-11 14:30:00 on dist-test-slave-cbbz"
server_key: "6929b3eba5f95a39e43e61c3d1658946"
server_key_iv: "990e76ecc48a0b051e6e199484d825a0"
server_key_version: "encryptionkey@0"
I20260811 14:30:00.503314 12793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:00.532213 12793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:00.534583 12793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:00.534754 12793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:00.539008 12793 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:46713
I20260811 14:30:00.539113 12869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:46713 every 8 connection(s)
I20260811 14:30:00.539427 12793 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:00.540099 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12793
I20260811 14:30:00.540282 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:00.540467 12871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:00.540488 21011 external_mini_cluster.cc:1428] Setting key 430399c18fd37013ce144be9fb4fa36c
I20260811 14:30:00.544001 12871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115: Bootstrap starting.
I20260811 14:30:00.544734 12871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:00.545039 12871 log.cc:824] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:00.545936 12871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115: No bootstrap required, opened a new log
I20260811 14:30:00.546737 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:00.541056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44031 (local address 127.20.132.254:46713)
0811 14:30:00.541253 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:00.541263 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:00.541299 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:30:00.541724 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:00.541733 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:00.541815 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:00.541972 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:00.542163 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:00.543521 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:00.544352 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:00.544996 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:00.545134 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:00.545964 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:00.545969 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:00.545969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:00.546215 (+ 246us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:00.546288 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:00.546304 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:00.546397 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:00.546483 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 14:30:00.546511 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":85,"threads_started":1}
I20260811 14:30:00.547865 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:00.548640 12871 raft_consensus.cc:348] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e054a656e56044a3994585452bcf8115" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46713 } }
I20260811 14:30:00.548803 12871 raft_consensus.cc:374] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:30:00.548828 12871 raft_consensus.cc:729] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e054a656e56044a3994585452bcf8115, State: Initialized, Role: FOLLOWER
I20260811 14:30:00.548975 12871 consensus_queue.cc:260] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e054a656e56044a3994585452bcf8115" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46713 } }
I20260811 14:30:00.549068 12871 raft_consensus.cc:388] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:30:00.549103 12871 raft_consensus.cc:482] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:30:00.549196 12871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:00.549945 12871 raft_consensus.cc:504] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e054a656e56044a3994585452bcf8115" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46713 } }
I20260811 14:30:00.550071 12871 leader_election.cc:302] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e054a656e56044a3994585452bcf8115; no voters:
I20260811 14:30:00.550241 12871 leader_election.cc:288] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:30:00.550290 12884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:00.550464 12884 raft_consensus.cc:686] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [term 1 LEADER]: Becoming Leader. State: Replica: e054a656e56044a3994585452bcf8115, State: Running, Role: LEADER
I20260811 14:30:00.550498 12871 sys_catalog.cc:564] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:00.550613 12884 consensus_queue.cc:237] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e054a656e56044a3994585452bcf8115" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46713 } }
I20260811 14:30:00.550973 12885 sys_catalog.cc:455] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e054a656e56044a3994585452bcf8115" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e054a656e56044a3994585452bcf8115" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46713 } } }
I20260811 14:30:00.551059 12885 sys_catalog.cc:458] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:00.551232 12887 sys_catalog.cc:455] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e054a656e56044a3994585452bcf8115. Latest consensus state: current_term: 1 leader_uuid: "e054a656e56044a3994585452bcf8115" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e054a656e56044a3994585452bcf8115" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46713 } } }
I20260811 14:30:00.551358 12887 sys_catalog.cc:458] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:00.551445 12891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:00.552032 12891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:00.553839 12891 catalog_manager.cc:1347] Generated new cluster ID: 03a3c14c269e4f94acd9b4217e5180c6
I20260811 14:30:00.553920 12891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:30:00.554286 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:00.549582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37549 (local address 127.20.132.254:46713)
0811 14:30:00.549619 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:00.549621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:00.550664 (+ 1043us) server_negotiation.cc:407] Connection header received
0811 14:30:00.550792 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:00.550793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:00.550804 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:00.550869 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:00.551149 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:00.551928 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:00.552852 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:00.553160 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:00.553246 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:00.553977 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:00.553978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:00.553978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:00.553982 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:00.553996 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:00.554001 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:00.554061 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:00.554198 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 14:30:00.554210 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 14:30:00.564672 12891 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:00.565359 12891 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:00.569128 12891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e054a656e56044a3994585452bcf8115: Generated new TSK 0
I20260811 14:30:00.569293 12891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:30:00.573000 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12793
W20260811 14:30:00.581337 12774 connection.cc:535] client connection to 127.20.132.254:46713 recv error: Network error: failed to read from TLS socket (remote: 127.20.132.254:46713): Connection reset by peer (error 104)
2026-08-11T14:30:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1378 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:30:00 dist-test-slave-cbbz krb5kdc[12909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:30:00 dist-test-slave-cbbz krb5kdc[12909](info): set up 2 sockets
Aug 11 14:30:00 dist-test-slave-cbbz krb5kdc[12909](info): commencing operation
krb5kdc: starting...
W20260811 14:30:01.662948 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:01 dist-test-slave-cbbz krb5kdc[12909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:01.782240 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:42011
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:42011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:01.863374 12922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:01.863570 12922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:01.863592 12922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:01.864674 12922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:01.864706 12922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:01.864722 12922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:01.864733 12922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:01.864745 12922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:01.866113 12922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:42011
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:42011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:01.866290 12922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:01.866493 12922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:01.871326 12927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:01.871490 12922 server_base.cc:1034] running on GCE node
W20260811 14:30:01.871340 12928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:01.871361 12930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:01.871863 12922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:01.872262 12922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:01.873426 12922 hybrid_clock.cc:648] HybridClock initialized: now 1786458601873414 us; error 26 us; skew 500 ppm
Aug 11 14:30:01 dist-test-slave-cbbz krb5kdc[12909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458601, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:01.875860 12922 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:01.876338 12922 webserver.cc:460] Webserver started at http://127.20.132.254:35489/ using document root <none> and password file <none>
I20260811 14:30:01.876531 12922 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:01.876572 12922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:01.876734 12922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:01.877704 12922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "59e5cab599f2471da11e39d37ba00f2f"
format_stamp: "Formatted at 2026-08-11 14:30:01 on dist-test-slave-cbbz"
server_key: "26c834a3446a3c5ae6c3e73bee9e74dc"
server_key_iv: "a86ac512e092b708fa41b36b88f74b55"
server_key_version: "encryptionkey@0"
I20260811 14:30:01.877991 12922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "59e5cab599f2471da11e39d37ba00f2f"
format_stamp: "Formatted at 2026-08-11 14:30:01 on dist-test-slave-cbbz"
server_key: "26c834a3446a3c5ae6c3e73bee9e74dc"
server_key_iv: "a86ac512e092b708fa41b36b88f74b55"
server_key_version: "encryptionkey@0"
I20260811 14:30:01.879222 12922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 14:30:01.879879 12937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:01.880034 12922 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:30:01.880119 12922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "59e5cab599f2471da11e39d37ba00f2f"
format_stamp: "Formatted at 2026-08-11 14:30:01 on dist-test-slave-cbbz"
server_key: "26c834a3446a3c5ae6c3e73bee9e74dc"
server_key_iv: "a86ac512e092b708fa41b36b88f74b55"
server_key_version: "encryptionkey@0"
I20260811 14:30:01.880239 12922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:01.883332 12922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:01.885542 12922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:01.885648 12922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:01.889365 12922 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:42011
I20260811 14:30:01.889436 12999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:42011 every 8 connection(s)
I20260811 14:30:01.889732 12922 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:01.890712 13000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:01.893004 13000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f: Bootstrap starting.
I20260811 14:30:01.893556 13000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:01.893851 13000 log.cc:824] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:01.894701 13000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f: No bootstrap required, opened a new log
I20260811 14:30:01.896474 13000 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e5cab599f2471da11e39d37ba00f2f" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42011 } }
I20260811 14:30:01.896628 13000 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:30:01.896688 13000 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59e5cab599f2471da11e39d37ba00f2f, State: Initialized, Role: FOLLOWER
I20260811 14:30:01.896864 13000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e5cab599f2471da11e39d37ba00f2f" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42011 } }
I20260811 14:30:01.896965 13000 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:30:01.897004 13000 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:30:01.897013 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 12922
I20260811 14:30:01.897056 13000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:01.897113 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:01.897325 21011 external_mini_cluster.cc:1428] Setting key 0ce21e896e401670cce9cd11c4b45ef6
I20260811 14:30:01.898118 13000 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e5cab599f2471da11e39d37ba00f2f" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42011 } }
I20260811 14:30:01.898206 13000 leader_election.cc:302] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59e5cab599f2471da11e39d37ba00f2f; no voters:
I20260811 14:30:01.898320 13000 leader_election.cc:288] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:30:01.898382 13005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:01.898520 13005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [term 1 LEADER]: Becoming Leader. State: Replica: 59e5cab599f2471da11e39d37ba00f2f, State: Running, Role: LEADER
I20260811 14:30:01.898576 13000 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:01.898674 13005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e5cab599f2471da11e39d37ba00f2f" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42011 } }
I20260811 14:30:01.899073 13007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59e5cab599f2471da11e39d37ba00f2f. Latest consensus state: current_term: 1 leader_uuid: "59e5cab599f2471da11e39d37ba00f2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e5cab599f2471da11e39d37ba00f2f" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42011 } } }
I20260811 14:30:01.899058 13006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59e5cab599f2471da11e39d37ba00f2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59e5cab599f2471da11e39d37ba00f2f" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 42011 } } }
I20260811 14:30:01.899159 13007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:01.899174 13006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:01.899377 13016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:01.899878 13016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:01.901530 13016 catalog_manager.cc:1347] Generated new cluster ID: 8a5bcb65f85d4df696629ad0251cb0cf
I20260811 14:30:01.901582 13016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:30:01.904430 13004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:01.897822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38199 (local address 127.20.132.254:42011)
0811 14:30:01.900180 (+ 2358us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:01.900189 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:01.900220 (+ 31us) server_negotiation.cc:407] Connection header received
0811 14:30:01.900332 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:01.900339 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:01.900368 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:01.900516 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:01.901294 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:01.901297 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:01.901297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:01.901302 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:01.901346 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:01.901361 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:01.901436 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:01.904216 (+ 2780us) server_negotiation.cc:299] Negotiation successful
0811 14:30:01.904257 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2293,"thread_start_us":92,"threads_started":1}
I20260811 14:30:01.905395 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:01.907882 13004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:01.906842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44731 (local address 127.20.132.254:42011)
0811 14:30:01.906872 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:01.906874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:01.907002 (+ 128us) server_negotiation.cc:407] Connection header received
0811 14:30:01.907062 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:01.907063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:01.907067 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:01.907122 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:01.907664 (+ 542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:01.907665 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:01.907665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:01.907669 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:01.907684 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:01.907688 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:01.907739 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:01.907812 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 14:30:01.907824 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 14:30:01.910167 13016 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:01.910315 13016 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:01.921440 13016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59e5cab599f2471da11e39d37ba00f2f: Generated new TSK 0
I20260811 14:30:01.921627 13016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:30:01.926610 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 12922
2026-08-11T14:30:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1352 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:30:01 dist-test-slave-cbbz krb5kdc[13035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:30:01 dist-test-slave-cbbz krb5kdc[13035](info): set up 2 sockets
Aug 11 14:30:01 dist-test-slave-cbbz krb5kdc[13035](info): commencing operation
krb5kdc: starting...
W20260811 14:30:03.030921 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:03 dist-test-slave-cbbz krb5kdc[13035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:03.155432 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:36227
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:44299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:36227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:03.236224 13048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:03.236429 13048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:03.236452 13048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:03.237522 13048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:03.237556 13048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:03.237571 13048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:03.237583 13048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:03.237596 13048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:03.238981 13048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:44299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:36227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:36227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:03.239168 13048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:03.239336 13048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:03.244117 13054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:03.244100 13056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:03.244156 13053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:03.244342 13048 server_base.cc:1034] running on GCE node
I20260811 14:30:03.244686 13048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:03.245004 13048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:03.246186 13048 hybrid_clock.cc:648] HybridClock initialized: now 1786458603246171 us; error 44 us; skew 500 ppm
Aug 11 14:30:03 dist-test-slave-cbbz krb5kdc[13035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458603, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:03.254403 13048 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:03.254859 13048 webserver.cc:460] Webserver started at http://127.20.132.254:43479/ using document root <none> and password file <none>
I20260811 14:30:03.255059 13048 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:03.255100 13048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:03.255196 13048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:03.256250 13048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "b358deb5486f4d4cb3510458e1bc8d71"
format_stamp: "Formatted at 2026-08-11 14:30:03 on dist-test-slave-cbbz"
server_key: "aee06fb240b3d94a69444dce6d8f6c68"
server_key_iv: "113a4bad400b0fcb00f698f110ec0bd9"
server_key_version: "encryptionkey@0"
I20260811 14:30:03.256549 13048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "b358deb5486f4d4cb3510458e1bc8d71"
format_stamp: "Formatted at 2026-08-11 14:30:03 on dist-test-slave-cbbz"
server_key: "aee06fb240b3d94a69444dce6d8f6c68"
server_key_iv: "113a4bad400b0fcb00f698f110ec0bd9"
server_key_version: "encryptionkey@0"
I20260811 14:30:03.257771 13048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:30:03.258432 13063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:03.258639 13048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:30:03.258736 13048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "b358deb5486f4d4cb3510458e1bc8d71"
format_stamp: "Formatted at 2026-08-11 14:30:03 on dist-test-slave-cbbz"
server_key: "aee06fb240b3d94a69444dce6d8f6c68"
server_key_iv: "113a4bad400b0fcb00f698f110ec0bd9"
server_key_version: "encryptionkey@0"
I20260811 14:30:03.258790 13048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:03.290257 13048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:03.292368 13048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:03.292480 13048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:03.296371 13048 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:36227
I20260811 14:30:03.296449 13118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:36227 every 8 connection(s)
I20260811 14:30:03.296795 13048 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:03.297693 13119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:03.299922 13119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71: Bootstrap starting.
I20260811 14:30:03.300535 13119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:03.300776 13119 log.cc:824] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:03.300840 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13048
I20260811 14:30:03.301008 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:03.301249 21011 external_mini_cluster.cc:1428] Setting key 84ca45986a99f360436e67e447a54642
I20260811 14:30:03.301612 13119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71: No bootstrap required, opened a new log
I20260811 14:30:03.303345 13119 raft_consensus.cc:348] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b358deb5486f4d4cb3510458e1bc8d71" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36227 } }
I20260811 14:30:03.303510 13119 raft_consensus.cc:374] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:30:03.303551 13119 raft_consensus.cc:729] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b358deb5486f4d4cb3510458e1bc8d71, State: Initialized, Role: FOLLOWER
I20260811 14:30:03.303755 13119 consensus_queue.cc:260] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b358deb5486f4d4cb3510458e1bc8d71" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36227 } }
I20260811 14:30:03.303857 13119 raft_consensus.cc:388] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:30:03.303891 13119 raft_consensus.cc:482] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:30:03.303946 13119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:03.304975 13119 raft_consensus.cc:504] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b358deb5486f4d4cb3510458e1bc8d71" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36227 } }
I20260811 14:30:03.305065 13119 leader_election.cc:302] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b358deb5486f4d4cb3510458e1bc8d71; no voters:
I20260811 14:30:03.305277 13119 leader_election.cc:288] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:30:03.305300 13125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:03.305414 13125 raft_consensus.cc:686] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [term 1 LEADER]: Becoming Leader. State: Replica: b358deb5486f4d4cb3510458e1bc8d71, State: Running, Role: LEADER
I20260811 14:30:03.305552 13119 sys_catalog.cc:564] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:03.305554 13125 consensus_queue.cc:237] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b358deb5486f4d4cb3510458e1bc8d71" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36227 } }
I20260811 14:30:03.306202 13126 sys_catalog.cc:455] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b358deb5486f4d4cb3510458e1bc8d71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b358deb5486f4d4cb3510458e1bc8d71" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36227 } } }
I20260811 14:30:03.306265 13127 sys_catalog.cc:455] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b358deb5486f4d4cb3510458e1bc8d71. Latest consensus state: current_term: 1 leader_uuid: "b358deb5486f4d4cb3510458e1bc8d71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b358deb5486f4d4cb3510458e1bc8d71" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 36227 } } }
I20260811 14:30:03.306285 13126 sys_catalog.cc:458] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:03.306378 13127 sys_catalog.cc:458] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:03.307121 13135 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:03.307693 13135 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:03.309401 13135 catalog_manager.cc:1347] Generated new cluster ID: 9c4fc727fdd54092b4a0544a7b19d601
I20260811 14:30:03.309453 13135 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 14:30:03 dist-test-slave-cbbz krb5kdc[13035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:03.313956 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:03.301779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55089 (local address 127.20.132.254:36227)
0811 14:30:03.301965 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:03.301973 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:03.302001 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:30:03.303329 (+ 1328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:03.303335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:03.303381 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:03.303493 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:03.304399 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:03.305432 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:03.306392 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:03.307008 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:03.307117 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:03.310078 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:03.310081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:03.310082 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:03.310094 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:03.312042 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:03.312451 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:03.312454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:03.312455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:03.312584 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:03.312801 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:03.312802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:03.312802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:03.313151 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:03.313345 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:03.313425 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 14:30:03.313561 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260811 14:30:03.314939 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:03.319660 13135 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:03.320386 13135 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:03.326678 13123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:03.316362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58131 (local address 127.20.132.254:36227)
0811 14:30:03.316394 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:03.316395 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:03.319621 (+ 3226us) server_negotiation.cc:407] Connection header received
0811 14:30:03.319800 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:03.319801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:03.319813 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:03.319881 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:03.320557 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:03.321298 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:03.322259 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:03.322587 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:03.322657 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:03.323934 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:03.323936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:03.323936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:03.323944 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:03.325548 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:03.325919 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:03.325920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:03.325920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:03.325979 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:03.326176 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:03.326177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:03.326177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:03.326301 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:03.326409 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:03.326498 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 14:30:03.326589 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 14:30:03.335048 13135 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b358deb5486f4d4cb3510458e1bc8d71: Generated new TSK 0
I20260811 14:30:03.335238 13135 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:30:03.338073 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13048
2026-08-11T14:30:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:30:03 dist-test-slave-cbbz krb5kdc[13154](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:30:03 dist-test-slave-cbbz krb5kdc[13154](info): set up 2 sockets
Aug 11 14:30:03 dist-test-slave-cbbz krb5kdc[13154](info): commencing operation
krb5kdc: starting...
W20260811 14:30:04.431856 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:04 dist-test-slave-cbbz krb5kdc[13154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:04.553231 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46339
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:39807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:46339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:04.634374 13168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:04.634626 13168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:04.634666 13168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:04.635847 13168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:04.635917 13168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:04.635944 13168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:04.635977 13168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:04.636001 13168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:04.637583 13168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:39807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:46339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:46339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:04.637862 13168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:04.638114 13168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:04.644544 13174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:04.644639 13177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:04.644841 13173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:04.645040 13168 server_base.cc:1034] running on GCE node
I20260811 14:30:04.645305 13168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:04.645622 13168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:04.646803 13168 hybrid_clock.cc:648] HybridClock initialized: now 1786458604646778 us; error 44 us; skew 500 ppm
Aug 11 14:30:04 dist-test-slave-cbbz krb5kdc[13154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458604, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:04.649360 13168 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:04.649827 13168 webserver.cc:460] Webserver started at http://127.20.132.254:41363/ using document root <none> and password file <none>
I20260811 14:30:04.650045 13168 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:04.650110 13168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:04.650265 13168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:04.651316 13168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1"
format_stamp: "Formatted at 2026-08-11 14:30:04 on dist-test-slave-cbbz"
server_key: "025bf7c046093ae831c0f57d2a5c1dc7"
server_key_iv: "64726f382f85ccd6ddba8bf080d6b155"
server_key_version: "encryptionkey@0"
I20260811 14:30:04.651685 13168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1"
format_stamp: "Formatted at 2026-08-11 14:30:04 on dist-test-slave-cbbz"
server_key: "025bf7c046093ae831c0f57d2a5c1dc7"
server_key_iv: "64726f382f85ccd6ddba8bf080d6b155"
server_key_version: "encryptionkey@0"
I20260811 14:30:04.653126 13168 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:30:04.653872 13185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:04.654050 13168 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:04.654145 13168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1"
format_stamp: "Formatted at 2026-08-11 14:30:04 on dist-test-slave-cbbz"
server_key: "025bf7c046093ae831c0f57d2a5c1dc7"
server_key_iv: "64726f382f85ccd6ddba8bf080d6b155"
server_key_version: "encryptionkey@0"
I20260811 14:30:04.654222 13168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:04.671221 13168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:04.673312 13168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:04.673472 13168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:04.677811 13168 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:46339
I20260811 14:30:04.677842 13240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:46339 every 8 connection(s)
I20260811 14:30:04.678216 13168 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:04.679039 13241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:04.681309 13241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1: Bootstrap starting.
I20260811 14:30:04.681906 13241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:04.682188 13241 log.cc:824] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:04.682876 13241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1: No bootstrap required, opened a new log
I20260811 14:30:04.684440 13241 raft_consensus.cc:348] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:30:04.684572 13241 raft_consensus.cc:374] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:30:04.684594 13241 raft_consensus.cc:729] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23c5a7b2c7a4db08a959d8f92a59fb1, State: Initialized, Role: FOLLOWER
I20260811 14:30:04.684777 13241 consensus_queue.cc:260] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:30:04.684859 13241 raft_consensus.cc:388] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:30:04.684901 13241 raft_consensus.cc:482] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:30:04.684949 13241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:04.685745 13241 raft_consensus.cc:504] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:30:04.685828 13241 leader_election.cc:302] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a23c5a7b2c7a4db08a959d8f92a59fb1; no voters:
I20260811 14:30:04.686026 13241 leader_election.cc:288] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:30:04.686062 13245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:04.686240 13245 raft_consensus.cc:686] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [term 1 LEADER]: Becoming Leader. State: Replica: a23c5a7b2c7a4db08a959d8f92a59fb1, State: Running, Role: LEADER
I20260811 14:30:04.686290 13241 sys_catalog.cc:564] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:04.686340 13245 consensus_queue.cc:237] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } }
I20260811 14:30:04.686767 13246 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } } }
I20260811 14:30:04.686796 13248 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a23c5a7b2c7a4db08a959d8f92a59fb1. Latest consensus state: current_term: 1 leader_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23c5a7b2c7a4db08a959d8f92a59fb1" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 46339 } } }
I20260811 14:30:04.686870 13246 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:04.686879 13248 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:04.687772 13259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:04.688230 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13168
I20260811 14:30:04.688342 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:04.688396 13259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:04.688519 21011 external_mini_cluster.cc:1428] Setting key 2871ddea6c2310c21beadf57007637ed
I20260811 14:30:04.689975 13259 catalog_manager.cc:1347] Generated new cluster ID: 417d57838414419987ed50d11cc05ac9
I20260811 14:30:04.690035 13259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:30:04.694657 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:04.689006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44851 (local address 127.20.132.254:46339)
0811 14:30:04.689175 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:04.689185 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:04.689484 (+ 299us) server_negotiation.cc:407] Connection header received
0811 14:30:04.689637 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:04.689642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:04.689685 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:04.689833 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:04.690070 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:04.691392 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:04.692565 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:04.693159 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:04.693256 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:04.693993 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:04.693997 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:04.693997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:04.694191 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:04.694227 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:04.694239 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:04.694304 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:04.694406 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 14:30:04.694463 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260811 14:30:04.695586 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:04.700292 13259 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:04.700531 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:04.697176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47723 (local address 127.20.132.254:46339)
0811 14:30:04.697208 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:04.697210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:04.697217 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:30:04.697237 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:04.697237 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:04.697246 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:04.697305 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:04.697423 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:04.698157 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:04.699120 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:04.699445 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:04.699517 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:04.700237 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:04.700238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:04.700238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:04.700243 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:04.700258 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:04.700263 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:04.700317 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:04.700443 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 14:30:04.700464 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":17}
I20260811 14:30:04.701059 13259 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:04.708865 13259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a23c5a7b2c7a4db08a959d8f92a59fb1: Generated new TSK 0
I20260811 14:30:04.709039 13259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:30:04.711601 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13168
2026-08-11T14:30:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1373 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:30:04 dist-test-slave-cbbz krb5kdc[13279](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:30:04 dist-test-slave-cbbz krb5kdc[13279](info): set up 2 sockets
Aug 11 14:30:04 dist-test-slave-cbbz krb5kdc[13279](info): commencing operation
krb5kdc: starting...
W20260811 14:30:05.799185 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:05 dist-test-slave-cbbz krb5kdc[13279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:05.916744 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:33607
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:38889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:33607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:05.996901 13294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:05.997107 13294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:05.997130 13294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:05.998283 13294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:05.998325 13294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:05.998339 13294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:05.998353 13294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:05.998364 13294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:05.999857 13294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:38889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:33607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:33607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:06.000121 13294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:06.000378 13294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:06.005489 13300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:06.005491 13301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:06.005553 13294 server_base.cc:1034] running on GCE node
W20260811 14:30:06.005522 13303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:06.005968 13294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:06.006265 13294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:06.007422 13294 hybrid_clock.cc:648] HybridClock initialized: now 1786458606007399 us; error 40 us; skew 500 ppm
Aug 11 14:30:06 dist-test-slave-cbbz krb5kdc[13279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458606, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:06.009933 13294 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:06.010432 13294 webserver.cc:460] Webserver started at http://127.20.132.254:43345/ using document root <none> and password file <none>
I20260811 14:30:06.010668 13294 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:06.010715 13294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:06.010874 13294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:06.011929 13294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "f492e6d77e1e430aa3378be2c9a3849a"
format_stamp: "Formatted at 2026-08-11 14:30:06 on dist-test-slave-cbbz"
server_key: "e07e91d801eb1a033b7550017ed9ac29"
server_key_iv: "1336629d7014e334fdf83c6002ea8e8a"
server_key_version: "encryptionkey@0"
I20260811 14:30:06.012323 13294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "f492e6d77e1e430aa3378be2c9a3849a"
format_stamp: "Formatted at 2026-08-11 14:30:06 on dist-test-slave-cbbz"
server_key: "e07e91d801eb1a033b7550017ed9ac29"
server_key_iv: "1336629d7014e334fdf83c6002ea8e8a"
server_key_version: "encryptionkey@0"
I20260811 14:30:06.013650 13294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:30:06.014453 13310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:06.014642 13294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:30:06.014714 13294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "f492e6d77e1e430aa3378be2c9a3849a"
format_stamp: "Formatted at 2026-08-11 14:30:06 on dist-test-slave-cbbz"
server_key: "e07e91d801eb1a033b7550017ed9ac29"
server_key_iv: "1336629d7014e334fdf83c6002ea8e8a"
server_key_version: "encryptionkey@0"
I20260811 14:30:06.014796 13294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:06.018071 13294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:06.019819 13294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:06.019968 13294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:06.023940 13294 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:33607
I20260811 14:30:06.023995 13368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:33607 every 8 connection(s)
I20260811 14:30:06.024329 13294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:06.025301 13369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:06.027467 13369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a: Bootstrap starting.
I20260811 14:30:06.028036 13369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:06.028381 13369 log.cc:824] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:06.029060 13369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a: No bootstrap required, opened a new log
I20260811 14:30:06.030629 13369 raft_consensus.cc:348] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f492e6d77e1e430aa3378be2c9a3849a" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 33607 } }
I20260811 14:30:06.030774 13369 raft_consensus.cc:374] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:30:06.030797 13369 raft_consensus.cc:729] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f492e6d77e1e430aa3378be2c9a3849a, State: Initialized, Role: FOLLOWER
I20260811 14:30:06.030984 13369 consensus_queue.cc:260] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f492e6d77e1e430aa3378be2c9a3849a" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 33607 } }
I20260811 14:30:06.031050 13369 raft_consensus.cc:388] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:30:06.031088 13369 raft_consensus.cc:482] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:30:06.031078 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13294
I20260811 14:30:06.031139 13369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:06.031213 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:06.031409 21011 external_mini_cluster.cc:1428] Setting key ca54bbf22bc13029115f7a2b54f38603
I20260811 14:30:06.032207 13369 raft_consensus.cc:504] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f492e6d77e1e430aa3378be2c9a3849a" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 33607 } }
I20260811 14:30:06.032331 13369 leader_election.cc:302] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f492e6d77e1e430aa3378be2c9a3849a; no voters:
I20260811 14:30:06.032491 13369 leader_election.cc:288] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:30:06.032522 13374 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:06.032755 13374 raft_consensus.cc:686] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [term 1 LEADER]: Becoming Leader. State: Replica: f492e6d77e1e430aa3378be2c9a3849a, State: Running, Role: LEADER
I20260811 14:30:06.032822 13369 sys_catalog.cc:564] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:06.032881 13374 consensus_queue.cc:237] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f492e6d77e1e430aa3378be2c9a3849a" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 33607 } }
I20260811 14:30:06.033227 13374 sys_catalog.cc:455] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f492e6d77e1e430aa3378be2c9a3849a. Latest consensus state: current_term: 1 leader_uuid: "f492e6d77e1e430aa3378be2c9a3849a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f492e6d77e1e430aa3378be2c9a3849a" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 33607 } } }
I20260811 14:30:06.033299 13374 sys_catalog.cc:458] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:06.033340 13375 sys_catalog.cc:455] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f492e6d77e1e430aa3378be2c9a3849a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f492e6d77e1e430aa3378be2c9a3849a" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 33607 } } }
I20260811 14:30:06.033427 13375 sys_catalog.cc:458] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:06.033864 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:06.031927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45857 (local address 127.20.132.254:33607)
0811 14:30:06.032127 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:06.032169 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:06.032202 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:30:06.032314 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:06.032336 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:06.032366 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:06.032504 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:06.033331 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:06.033334 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:06.033335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:06.033341 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:06.033389 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:06.033404 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:06.033474 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:06.033633 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 14:30:06.033679 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260811 14:30:06.034384 13380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:06.034763 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:06.034950 13380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:06.036511 13380 catalog_manager.cc:1347] Generated new cluster ID: 9d87601c2e1644a4a9451126fb9842a4
I20260811 14:30:06.036561 13380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:30:06.041198 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:06.036418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59307 (local address 127.20.132.254:33607)
0811 14:30:06.036454 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:06.036456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:06.040329 (+ 3873us) server_negotiation.cc:407] Connection header received
0811 14:30:06.040392 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:06.040393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:06.040398 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:06.040454 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:06.041008 (+ 554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:06.041009 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:06.041009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:30:06.041013 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:06.041027 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:30:06.041031 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:06.041084 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:06.041129 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 14:30:06.041141 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:30:06.049969 13380 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:06.050103 13380 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:06.053623 13380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f492e6d77e1e430aa3378be2c9a3849a: Generated new TSK 0
I20260811 14:30:06.053762 13380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:30:06.057817 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13294
2026-08-11T14:30:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1345 ms)
[----------] 18 tests from AuthTokenIssuingTest (24854 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:30:06 dist-test-slave-cbbz krb5kdc[13403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:30:06 dist-test-slave-cbbz krb5kdc[13403](info): set up 2 sockets
Aug 11 14:30:06 dist-test-slave-cbbz krb5kdc[13403](info): commencing operation
krb5kdc: starting...
W20260811 14:30:07.214879 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:07.332484 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:32881
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:46023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:32881,127.20.132.253:33029,127.20.132.252:43285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:07.412909 13417 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 14:30:07.413143 13417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:07.413172 13417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:07.413204 13417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:07.414346 13417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:07.414413 13417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:07.414438 13417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:07.414467 13417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:07.414497 13417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:07.415968 13417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:32881,127.20.132.253:33029,127.20.132.252:43285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:32881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:07.416265 13417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:07.416491 13417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:07.421339 13423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:07.421383 13422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:07.421396 13425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:07.421516 13417 server_base.cc:1034] running on GCE node
I20260811 14:30:07.421826 13417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:07.422153 13417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:07.423302 13417 hybrid_clock.cc:648] HybridClock initialized: now 1786458607423284 us; error 40 us; skew 500 ppm
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:07.425820 13417 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:07.426244 13417 webserver.cc:460] Webserver started at http://127.20.132.254:34755/ using document root <none> and password file <none>
I20260811 14:30:07.426476 13417 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:07.426544 13417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:07.426689 13417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:07.427726 13417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "97dfa03e2def4fd3892f31164c2c6111"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "b515daf6e333b3b3b5ab82e046c313ff"
server_key_iv: "96b0bb089657a0196d9a1acb847f1732"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.428092 13417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "97dfa03e2def4fd3892f31164c2c6111"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "b515daf6e333b3b3b5ab82e046c313ff"
server_key_iv: "96b0bb089657a0196d9a1acb847f1732"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.429441 13417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:30:07.430135 13434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:07.430316 13417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 14:30:07.430414 13417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "97dfa03e2def4fd3892f31164c2c6111"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "b515daf6e333b3b3b5ab82e046c313ff"
server_key_iv: "96b0bb089657a0196d9a1acb847f1732"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.430496 13417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:07.444485 13417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:07.446468 13417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:07.446642 13417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:07.450723 13417 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:32881
I20260811 14:30:07.450778 13497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:32881 every 8 connection(s)
I20260811 14:30:07.451160 13417 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:07.452054 13499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:07.453646 13499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:07.457152 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13417
I20260811 14:30:07.457252 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:07.457472 21011 external_mini_cluster.cc:1428] Setting key 9f3ff0dcc91999999f81a8ca6ce939d5
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:07.463967 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.454261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:32881 (local address 127.0.0.1:45108)
0811 14:30:07.454491 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.454534 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.455023 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.455321 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.455324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.455605 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.455757 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.455762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.456864 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.456865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.457686 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.457690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.458185 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.458186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.458249 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.458808 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.458816 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.460475 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.462411 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.462417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.462419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.462633 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.462893 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.462893 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.462894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.462984 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.463364 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.463369 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.463430 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.463543 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.463793 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":98,"thread_start_us":94,"threads_started":1}
I20260811 14:30:07.463970 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.454331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.20.132.254:32881)
0811 14:30:07.454500 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.454509 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.454634 (+ 125us) server_negotiation.cc:407] Connection header received
0811 14:30:07.455193 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.455199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.455218 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.455316 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.455861 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.456751 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.457781 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.458082 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.458216 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.460564 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.460572 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.460572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.460580 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.462281 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.462733 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.462736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.462736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.462819 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.463061 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.463062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.463062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.463288 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.463384 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.463577 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.463727 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":65,"threads_started":1}
I20260811 14:30:07.464866 13499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:07.465274 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.465150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41554)
0811 14:30:07.465201 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.465247 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 14:30:07.465441 13435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.132.253@KRBTEST.COM; defaulting to no policy
I20260811 14:30:07.465881 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.465801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41568)
0811 14:30:07.465833 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.465865 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 14:30:07.466080 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:33029: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab.
Entry for principal kudu/127.20.132.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab.
I20260811 14:30:07.483295 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:33029
--webserver_interface=127.20.132.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab
--principal=kudu/127.20.132.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:46023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:32881,127.20.132.253:33029,127.20.132.252:43285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:30:07.515308 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } attempt: 1
I20260811 14:30:07.515868 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.515732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41580)
0811 14:30:07.515798 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.515839 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 14:30:07.516292 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.516207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41588)
0811 14:30:07.516249 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.516275 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 14:30:07.516400 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:33029: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
W20260811 14:30:07.565318 13507 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 14:30:07.565523 13507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:07.565541 13507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:07.565560 13507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:07.566759 13507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:07.566802 13507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:07.566815 13507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:07.566828 13507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:07.566888 13507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:07.568356 13507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:32881,127.20.132.253:33029,127.20.132.252:43285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab
--principal=kudu/127.20.132.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:33029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.132.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:07.568603 13507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:07.568835 13507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:30:07.573921 13507 server_base.cc:1034] running on GCE node
W20260811 14:30:07.573848 13516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:07.573843 13514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:07.573876 13513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:07.574314 13507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:07.574630 13507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:07.575786 13507 hybrid_clock.cc:648] HybridClock initialized: now 1786458607575766 us; error 35 us; skew 500 ppm
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:07.578661 13507 init.cc:377] Logged in from keytab as kudu/127.20.132.253@KRBTEST.COM (short username kudu)
I20260811 14:30:07.579118 13507 webserver.cc:460] Webserver started at http://127.20.132.253:42007/ using document root <none> and password file <none>
I20260811 14:30:07.579303 13507 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:07.579344 13507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:07.579430 13507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:07.580524 13507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data/instance:
uuid: "a681e6c66d2b41c186127f98d1d1a356"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "c97df0fc9af51c83a1804ea734fc31f0"
server_key_iv: "87c9a495c6e542f40aa0c5bcf7a83c39"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.580840 13507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal/instance:
uuid: "a681e6c66d2b41c186127f98d1d1a356"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "c97df0fc9af51c83a1804ea734fc31f0"
server_key_iv: "87c9a495c6e542f40aa0c5bcf7a83c39"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.582104 13507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:30:07.582783 13524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:07.582959 13507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 14:30:07.583046 13507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal
uuid: "a681e6c66d2b41c186127f98d1d1a356"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "c97df0fc9af51c83a1804ea734fc31f0"
server_key_iv: "87c9a495c6e542f40aa0c5bcf7a83c39"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.583099 13507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:07.584534 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } attempt: 2
I20260811 14:30:07.584918 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.584789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41604)
0811 14:30:07.584850 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.584881 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 14:30:07.585299 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.585204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41610)
0811 14:30:07.585252 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.585277 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 14:30:07.585444 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:33029: Network error: Client connection negotiation failed: client connection to 127.20.132.253:33029: connect: Connection refused (error 111)
I20260811 14:30:07.594092 13507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:07.596388 13507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:07.596499 13507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:07.600236 13507 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.253:33029
I20260811 14:30:07.600310 13584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.253:33029 every 8 connection(s)
I20260811 14:30:07.600642 13507 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
I20260811 14:30:07.601518 13585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:07.602990 13585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:07.608364 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13507
I20260811 14:30:07.608484 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-1/wal/instance
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:07.608698 21011 external_mini_cluster.cc:1428] Setting key e357dad6b0df36a98baa648d1ed61bda
I20260811 14:30:07.612123 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.603631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45122 (local address 127.20.132.254:32881)
0811 14:30:07.603690 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.603692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.603902 (+ 210us) server_negotiation.cc:407] Connection header received
0811 14:30:07.604455 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.604457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.604471 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.604552 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.605142 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.605645 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.606581 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.606784 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.606852 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.609108 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.609109 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.609110 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.609118 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.610707 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.611199 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.611200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.611200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.611252 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.611533 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.611534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.611534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.611632 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.611682 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.611994 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.612061 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:30:07.612419 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.603594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:32881 (local address 127.0.0.1:45122)
0811 14:30:07.603777 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.603816 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.604339 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.604618 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.604621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.604849 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.605028 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.605032 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.605739 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.605739 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.606490 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.606492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.606868 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.606868 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.606962 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.607492 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.607507 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.609015 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.610792 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.610800 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.610802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.611120 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.611321 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.611321 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.611322 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.611461 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.611698 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.611705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.611861 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.611974 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.612157 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
I20260811 14:30:07.613011 13585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.132.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.252@KRBTEST.COM" created.
I20260811 14:30:07.620601 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.613256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41612)
0811 14:30:07.613305 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.613315 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.613355 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.613649 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.613650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.613763 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.613814 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.613815 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.615136 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.615137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.615628 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.615629 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.616276 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.616277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.616330 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.616729 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.616734 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.617915 (+ 1181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.619461 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.619462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.619462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.619624 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.619866 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.619867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.619868 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.619930 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.620304 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.620305 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.620349 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.620414 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.620482 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:30:07.620808 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.613312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41612 (local address 127.20.132.253:33029)
0811 14:30:07.613473 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.613478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.613501 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:30:07.613526 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.613529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.613544 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.613648 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.613890 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.615043 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.615706 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.616202 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.616279 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.618001 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.618009 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.618010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.618017 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.619385 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.619722 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.619725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.619725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.619790 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.619996 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.619997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.619997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.620227 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.620304 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.620481 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.620596 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260811 14:30:07.622555 13585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:07.622948 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.622786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52158)
0811 14:30:07.622849 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.622919 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 14:30:07.623101 13525 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
I20260811 14:30:07.623598 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.623466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52160)
0811 14:30:07.623519 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.623565 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 14:30:07.623749 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:43285: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab.
Entry for principal kudu/127.20.132.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab.
I20260811 14:30:07.635349 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:43285
--webserver_interface=127.20.132.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab
--principal=kudu/127.20.132.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:46023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:32881,127.20.132.253:33029,127.20.132.252:43285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:30:07.672987 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } attempt: 1
I20260811 14:30:07.673580 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.673410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52164)
0811 14:30:07.673486 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.673536 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 14:30:07.673974 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.673885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52166)
0811 14:30:07.673928 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.673955 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 14:30:07.674068 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:43285: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
I20260811 14:30:07.676581 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } attempt: 3
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
I20260811 14:30:07.683851 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.676963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41622 (local address 127.20.132.253:33029)
0811 14:30:07.677027 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.677029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.677042 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:30:07.677100 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.677101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.677114 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.677177 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.677487 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.678261 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.678964 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.679302 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.679376 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.681456 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.681457 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.681457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.681463 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.682792 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.683164 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.683164 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.683165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.683223 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.683414 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.683415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.683415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.683511 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.683563 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.683723 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.683787 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:30:07.683882 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.676901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41622)
0811 14:30:07.676981 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.676993 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.677051 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.677190 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.677191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.677345 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.677413 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.677415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.678355 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.678356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.678883 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.678885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.679375 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.679376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.679435 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.679906 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.679911 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.681375 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.682874 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.682875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.682875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.683090 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.683288 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.683288 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.683289 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.683354 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.683577 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.683578 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.683625 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.683694 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.683790 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 14:30:07.684371 13499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:07.684754 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.684647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52170)
0811 14:30:07.684696 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.684729 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 14:30:07.685084 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.684993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52176)
0811 14:30:07.685038 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.685065 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:30:07.685186 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:43285: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
I20260811 14:30:07.716342 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } attempt: 1
I20260811 14:30:07.716822 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.716658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52182)
0811 14:30:07.716742 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.716785 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 14:30:07.717207 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.717101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52186)
0811 14:30:07.717151 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.717183 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 14:30:07.717346 13499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:43285: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
W20260811 14:30:07.720299 13592 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 14:30:07.720481 13592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:07.720498 13592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:07.720556 13592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:07.721707 13592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:07.721743 13592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:07.721758 13592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:07.721822 13592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:07.721840 13592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:07.723278 13592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:46023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:32881,127.20.132.253:33029,127.20.132.252:43285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab
--principal=kudu/127.20.132.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:43285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.132.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:07.723522 13592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:07.723748 13592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:07.728471 13600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:07.728493 13602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:07.728528 13599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:07.728709 13592 server_base.cc:1034] running on GCE node
I20260811 14:30:07.728948 13592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:07.729209 13592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:07.730376 13592 hybrid_clock.cc:648] HybridClock initialized: now 1786458607730355 us; error 49 us; skew 500 ppm
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:07.732769 13592 init.cc:377] Logged in from keytab as kudu/127.20.132.252@KRBTEST.COM (short username kudu)
I20260811 14:30:07.733201 13592 webserver.cc:460] Webserver started at http://127.20.132.252:38957/ using document root <none> and password file <none>
I20260811 14:30:07.733433 13592 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:07.733497 13592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:07.733625 13592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:07.734633 13592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data/instance:
uuid: "65056913fce3442987f7e8c28b363372"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "1b98908d2a8ede7205864c30b00042e0"
server_key_iv: "82d1fa7025b81c4cddd67072ac69c4ed"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.734994 13592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal/instance:
uuid: "65056913fce3442987f7e8c28b363372"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "1b98908d2a8ede7205864c30b00042e0"
server_key_iv: "82d1fa7025b81c4cddd67072ac69c4ed"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.736346 13592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 14:30:07.737051 13609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:07.737221 13592 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:07.737319 13592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal
uuid: "65056913fce3442987f7e8c28b363372"
format_stamp: "Formatted at 2026-08-11 14:30:07 on dist-test-slave-cbbz"
server_key: "1b98908d2a8ede7205864c30b00042e0"
server_key_iv: "82d1fa7025b81c4cddd67072ac69c4ed"
server_key_version: "encryptionkey@0"
I20260811 14:30:07.737398 13592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:07.742199 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } attempt: 2
I20260811 14:30:07.742558 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.742440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52202)
0811 14:30:07.742495 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.742531 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:30:07.742856 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.742767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52208)
0811 14:30:07.742811 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.742834 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 14:30:07.742950 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:43285: Network error: Client connection negotiation failed: client connection to 127.20.132.252:43285: connect: Connection refused (error 111)
I20260811 14:30:07.762908 13592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:07.764972 13592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:07.765143 13592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:07.769207 13592 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.252:43285
I20260811 14:30:07.769253 13674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.252:43285 every 8 connection(s)
I20260811 14:30:07.769626 13592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
I20260811 14:30:07.770320 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13592
I20260811 14:30:07.770422 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786458335845753-21011-0/minicluster-data/master-2/wal/instance
I20260811 14:30:07.770642 21011 external_mini_cluster.cc:1428] Setting key 31b2baa700a4f4582fac661a9a2a68ca
I20260811 14:30:07.770673 13675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:07.773253 13675 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:07.781497 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.771230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52224 (local address 127.20.132.252:43285)
0811 14:30:07.771409 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.771418 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.771452 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:30:07.771851 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.771858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.771904 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.772014 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.772862 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.773805 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.774765 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.775147 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.775274 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.777833 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.777839 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.777839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.777845 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.779876 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.780253 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.780256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.780257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.780360 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.780569 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.780570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.780570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.780897 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.781048 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.781129 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.781268 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260811 14:30:07.781548 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.773911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45132 (local address 127.20.132.254:32881)
0811 14:30:07.773968 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.773970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.774123 (+ 153us) server_negotiation.cc:407] Connection header received
0811 14:30:07.774182 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.774183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.774194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.774254 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.774637 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.775132 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.776080 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.776427 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.776511 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.778596 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.778598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.778598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.778605 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.780205 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.780664 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.780665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.780665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.780721 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.780902 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.780903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.780904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.781037 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.781107 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.781370 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.781449 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 14:30:07.781597 13679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.773867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:32881 (local address 127.0.0.1:45132)
0811 14:30:07.774010 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.774049 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.774124 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.774265 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.774266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.774498 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.774563 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.774565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.775217 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.775218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.775989 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.775992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.776515 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.776516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.776571 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.777027 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.777035 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.778512 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.780290 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.780296 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.780298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.780585 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.780788 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.780788 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.780788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.780841 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.781113 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.781119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.781189 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.781334 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.781451 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260811 14:30:07.782444 13675 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:07.789687 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.782797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41636 (local address 127.20.132.253:33029)
0811 14:30:07.782842 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.782844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.782853 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:30:07.782878 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.782879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.782890 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.782964 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.783207 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.783661 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.784384 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.784606 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.784698 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.786676 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.786678 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.786678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.786686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.788566 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.788891 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.788892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.788892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.788953 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.789172 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.789172 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.789173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.789291 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.789366 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.789518 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.789589 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:30:07.789695 13679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.782712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:33029 (local address 127.0.0.1:41636)
0811 14:30:07.782761 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.782770 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.782804 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.782964 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.782964 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.783072 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.783121 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.783122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.783743 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.783744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.784300 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.784302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.784698 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.784699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.784768 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.785316 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.785320 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.786566 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.788627 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.788628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.788628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.788785 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.789034 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.789035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.789035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.789099 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.789358 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.789359 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.789402 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.789491 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.789589 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:30:07.790406 13675 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:07.790855 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.782319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45140 (local address 127.20.132.254:32881)
0811 14:30:07.782352 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.782354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.782378 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:30:07.782435 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.782436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.782444 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.782496 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.783196 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.783635 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.784377 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.784567 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.784650 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.787614 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.787615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.787616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.787625 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.789637 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.790016 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.790017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.790017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.790075 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.790285 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.790286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.790286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.790418 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.790613 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.790665 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.790752 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:30:07.792536 13499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } attempt: 2
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:30:07.798219 13679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.790677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52226)
0811 14:30:07.790723 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.790732 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.790768 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.790909 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.790909 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.791065 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.791161 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.791163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.791956 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.791957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.792663 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.792674 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.793159 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.793159 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.793204 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.793571 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.793576 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.794955 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.796794 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.796795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.796796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.796996 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.797194 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.797194 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.797194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.797240 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.797847 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.797848 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.797884 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.797953 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.798050 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":54}
I20260811 14:30:07.798275 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.790733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52226 (local address 127.20.132.252:43285)
0811 14:30:07.790771 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.790774 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.790803 (+ 29us) server_negotiation.cc:407] Connection header received
0811 14:30:07.790822 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.790823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.790833 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.790887 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.791239 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.791881 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.792740 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.793054 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.793116 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.795045 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.795046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.795047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.795054 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.796720 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.797083 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.797084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.797085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.797134 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.797335 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.797336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.797337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.797756 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.797823 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.797975 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.798101 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":20}
I20260811 14:30:07.799852 13675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: Bootstrap starting.
I20260811 14:30:07.799980 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.791562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41650 (local address 127.20.132.253:33029)
0811 14:30:07.791601 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.791603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.791656 (+ 53us) server_negotiation.cc:407] Connection header received
0811 14:30:07.791721 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.791722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.791730 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.791766 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.792341 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.792957 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.793920 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.794205 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.794239 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.796961 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.796962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.796962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.796969 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.798643 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.799045 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.799046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.799047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.799102 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.799435 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.799436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.799437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.799575 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.799771 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.799810 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.799897 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:30:07.800731 13675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:07.801059 13675 log.cc:824] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:07.801471 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.792764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52242)
0811 14:30:07.792809 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.792818 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.792849 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.793302 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.793303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.793469 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.793509 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.793510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.794772 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.794773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.795362 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.795364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.795702 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.795703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.795758 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.796279 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.796284 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.797612 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.800335 (+ 2723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.800337 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.800338 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.800517 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.800738 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.800739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.800739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.800849 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.801175 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.801176 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.801223 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.801278 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.801372 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 14:30:07.801745 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:07.801867 13680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.792986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52242 (local address 127.20.132.252:43285)
0811 14:30:07.793175 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.793177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.793184 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:30:07.793207 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.793208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.793216 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.793297 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.793605 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.794645 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.795436 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.795623 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.795700 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.797700 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.797701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.797701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.797708 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.800243 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.800621 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.800621 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.800622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.800688 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.800915 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.800916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.800916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.801075 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.801586 (+ 511us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.801639 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.801718 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":135,"threads_started":1}
I20260811 14:30:07.801978 13675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: No bootstrap required, opened a new log
I20260811 14:30:07.803849 13499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111: Bootstrap starting.
I20260811 14:30:07.802940 13468 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "97dfa03e2def4fd3892f31164c2c6111"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45140
I20260811 14:30:07.804569 13499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:07.804874 13499 log.cc:824] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:07.805574 13499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111: No bootstrap required, opened a new log
I20260811 14:30:07.806311 13675 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.806463 13675 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65056913fce3442987f7e8c28b363372, State: Initialized, Role: FOLLOWER
I20260811 14:30:07.806538 13675 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.806661 13499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.806789 13499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97dfa03e2def4fd3892f31164c2c6111, State: Initialized, Role: FOLLOWER
I20260811 14:30:07.806847 13675 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:07.806809 13683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.806893 13683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:07.806875 13499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.807191 13499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:07.807160 13685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.807238 13685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:07.807271 13468 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 14:30:07.807346 13468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:07.808283 13468 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.808522 13468 leader_election.cc:288] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [CANDIDATE]: Term 1 election: Requested vote from peers a681e6c66d2b41c186127f98d1d1a356 (127.20.132.253:33029), 65056913fce3442987f7e8c28b363372 (127.20.132.252:43285)
I20260811 14:30:07.808918 13641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97dfa03e2def4fd3892f31164c2c6111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "65056913fce3442987f7e8c28b363372"
I20260811 14:30:07.809031 13641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [term 0 FOLLOWER]: Advancing to term 1
W20260811 14:30:07.809157 13703 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:30:07.809195 13703 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:30:07.809856 13641 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97dfa03e2def4fd3892f31164c2c6111 in term 1.
I20260811 14:30:07.810074 13435 leader_election.cc:302] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65056913fce3442987f7e8c28b363372, 97dfa03e2def4fd3892f31164c2c6111; no voters:
I20260811 14:30:07.810189 13685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:07.810642 13685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [term 1 LEADER]: Becoming Leader. State: Replica: 97dfa03e2def4fd3892f31164c2c6111, State: Running, Role: LEADER
I20260811 14:30:07.810729 13685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
W20260811 14:30:07.811551 13716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:30:07.811600 13716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:30:07.811802 13718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97dfa03e2def4fd3892f31164c2c6111. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.811867 13718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:07.809962 13592 master_runner.cc:186] Error getting master registration for 127.20.132.254:32881: OK, instance_id { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" instance_seqno: 1786458607449557 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 14:30:07.812394 13592 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 14:30:07.812110 13417 master_runner.cc:186] Error getting master registration for 127.20.132.253:33029: OK, instance_id { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" instance_seqno: 1786458607599191 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 14:30:07.813920 13417 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 14:30:07.818717 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.810025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.20.132.254:32881)
0811 14:30:07.810198 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.810201 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.811015 (+ 814us) server_negotiation.cc:407] Connection header received
0811 14:30:07.811110 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.811111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.811122 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.811153 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.812010 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.812778 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.813807 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.814087 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.814129 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.815667 (+ 1538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.815668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.815668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.815674 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.817405 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.817809 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.817810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.817811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.817876 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.818120 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.818121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.818122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.818246 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.818352 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.818506 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.818593 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260811 14:30:07.824287 13722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:07.824558 13722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:07.825603 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.810336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.20.132.253:33029)
0811 14:30:07.810391 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.810393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.816298 (+ 5905us) server_negotiation.cc:407] Connection header received
0811 14:30:07.816383 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.816385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.816398 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.816470 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.817116 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.817740 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.818800 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.819548 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.819595 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.821211 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.821213 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.821213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.821220 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.822941 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.824399 (+ 1458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.824400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.824401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.824465 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.824947 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.824948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.824949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.825092 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.825195 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.825413 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.825502 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 14:30:07.827525 13680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.810649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52248 (local address 127.20.132.252:43285)
0811 14:30:07.810690 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.810692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.818707 (+ 8015us) server_negotiation.cc:407] Connection header received
0811 14:30:07.819170 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.819171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.819208 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.819290 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.819881 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.820711 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.822266 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.822667 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.822716 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.824386 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.824387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.824388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.824396 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.826187 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.826672 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.826673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.826673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.826747 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.826971 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.826972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.826973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.827084 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.827210 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.827328 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.827409 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 14:30:07.829095 13641 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [term 1 FOLLOWER]: Refusing update from remote peer 97dfa03e2def4fd3892f31164c2c6111: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:30:07.829423 13685 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:30:07.830847 13683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97dfa03e2def4fd3892f31164c2c6111. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.830955 13683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:07.834064 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } attempt: 3
Aug 11 14:30:07 dist-test-slave-cbbz krb5kdc[13403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458607, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:30:07.842028 13587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.834298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:43285 (local address 127.0.0.1:52260)
0811 14:30:07.834346 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:07.834357 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:07.834397 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:07.834521 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:07.834522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:07.834702 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:07.834747 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.834749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.835647 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.835647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.836467 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:07.836469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.836911 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.836912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:07.836964 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.837429 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:07.837434 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:07.838995 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:07.840943 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.840944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.840945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.841183 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.841391 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:07.841392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:07.841393 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:07.841446 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:07.841702 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:07.841703 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:07.841746 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 14:30:07.841825 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:30:07.841927 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 14:30:07.842150 13680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:07.834348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52260 (local address 127.20.132.252:43285)
0811 14:30:07.834395 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.834397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.834406 (+ 9us) server_negotiation.cc:407] Connection header received
0811 14:30:07.834459 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.834460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.834468 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.834513 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.834823 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.835559 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.836551 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:07.836850 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:07.836907 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:07.839087 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:07.839088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:07.839089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:07.839097 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:07.840872 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.841265 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.841266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.841267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.841319 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:07.841497 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:07.841498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:07.841499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:07.841639 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:07.841701 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:07.841888 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 14:30:07.842004 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 14:30:07.843956 13585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: Bootstrap starting.
I20260811 14:30:07.844739 13585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:07.845068 13585 log.cc:824] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:07.845809 13685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.845912 13685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:07.846503 13683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.846588 13683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:07.847245 13585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: No bootstrap required, opened a new log
I20260811 14:30:07.849400 13585 raft_consensus.cc:348] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.849530 13585 raft_consensus.cc:729] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a681e6c66d2b41c186127f98d1d1a356, State: Initialized, Role: FOLLOWER
I20260811 14:30:07.849615 13585 consensus_queue.cc:260] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } }
I20260811 14:30:07.849984 13724 mvcc.cc:205] Tried to move back new op lower bound from 7317334457665294336 to 7317334457593364480. Current Snapshot: MvccSnapshot[applied={T|T < 7317334457665294336}]
I20260811 14:30:07.849906 13729 sys_catalog.cc:455] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.850034 13554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97dfa03e2def4fd3892f31164c2c6111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a681e6c66d2b41c186127f98d1d1a356"
I20260811 14:30:07.850265 13729 sys_catalog.cc:458] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:07.850009 13553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:07.851146 13553 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [term 1 FOLLOWER]: Refusing update from remote peer 97dfa03e2def4fd3892f31164c2c6111: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:30:07.852015 13554 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97dfa03e2def4fd3892f31164c2c6111 in term 1.
I20260811 14:30:07.849933 13585 sys_catalog.cc:564] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:07.851490 13718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 14:30:07.850103 13723 mvcc.cc:205] Tried to move back new op lower bound from 7317334457665294336 to 7317334457593364480. Current Snapshot: MvccSnapshot[applied={T|T < 7317334457665294336}]
I20260811 14:30:07.855271 13722 catalog_manager.cc:1347] Generated new cluster ID: a0d20b5ba18b4b7ba117dd820137dc86
I20260811 14:30:07.855340 13722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:30:07.855635 13729 sys_catalog.cc:455] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97dfa03e2def4fd3892f31164c2c6111. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.855716 13729 sys_catalog.cc:458] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:07.855755 13729 sys_catalog.cc:455] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.855793 13729 sys_catalog.cc:458] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 14:30:07.856317 13743 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:30:07.856367 13743 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:30:07.864411 13744 mvcc.cc:205] Tried to move back new op lower bound from 7317334457665294336 to 7317334457593364480. Current Snapshot: MvccSnapshot[applied={T|T < 7317334457665294336}]
I20260811 14:30:07.867599 13718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97dfa03e2def4fd3892f31164c2c6111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97dfa03e2def4fd3892f31164c2c6111" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 32881 } } peers { permanent_uuid: "a681e6c66d2b41c186127f98d1d1a356" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 33029 } } peers { permanent_uuid: "65056913fce3442987f7e8c28b363372" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 43285 } } }
I20260811 14:30:07.867728 13718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111 [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:07.868536 13722 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:07.869261 13722 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:07.876592 13722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97dfa03e2def4fd3892f31164c2c6111: Generated new TSK 0
I20260811 14:30:07.876803 13722 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:30:07.900187 13502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.898545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45154 (local address 127.20.132.254:32881)
0811 14:30:07.898589 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.898591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.899451 (+ 860us) server_negotiation.cc:407] Connection header received
0811 14:30:07.899557 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.899558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.899569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.899600 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.900083 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45154: BlockingRecv error: recv got EOF from 127.0.0.1:45154 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 14:30:07.901140 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.898914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41670 (local address 127.20.132.253:33029)
0811 14:30:07.898958 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.898959 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.900625 (+ 1666us) server_negotiation.cc:407] Connection header received
0811 14:30:07.900726 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.900727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.900738 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.900767 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.901080 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41670: BlockingRecv error: recv got EOF from 127.0.0.1:41670 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 14:30:07.902004 13680 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.899195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52268 (local address 127.20.132.252:43285)
0811 14:30:07.899236 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.899238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.901473 (+ 2235us) server_negotiation.cc:407] Connection header received
0811 14:30:07.901568 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.901569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.901580 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.901609 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.901945 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52268: BlockingRecv error: recv got EOF from 127.0.0.1:52268 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 14:30:07.904440 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.903372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41678 (local address 127.20.132.253:33029)
0811 14:30:07.903408 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.903410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.903925 (+ 515us) server_negotiation.cc:407] Connection header received
0811 14:30:07.904030 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.904031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.904049 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.904077 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.904398 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41678: BlockingRecv error: recv got EOF from 127.0.0.1:41678 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 14:30:07.907464 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.906777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41690 (local address 127.20.132.253:33029)
0811 14:30:07.906810 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.906811 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.907011 (+ 200us) server_negotiation.cc:407] Connection header received
0811 14:30:07.907101 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.907102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.907111 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.907141 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.907422 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41690: BlockingRecv error: recv got EOF from 127.0.0.1:41690 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 14:30:07.911285 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.910642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41696 (local address 127.20.132.253:33029)
0811 14:30:07.910674 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.910675 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.910857 (+ 182us) server_negotiation.cc:407] Connection header received
0811 14:30:07.910941 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.910942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.910951 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.910978 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.911250 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41696: BlockingRecv error: recv got EOF from 127.0.0.1:41696 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 14:30:07.917306 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.916542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41708 (local address 127.20.132.253:33029)
0811 14:30:07.916576 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.916578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.916795 (+ 217us) server_negotiation.cc:407] Connection header received
0811 14:30:07.916891 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.916892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.916902 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.916931 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.917266 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41708: BlockingRecv error: recv got EOF from 127.0.0.1:41708 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 14:30:07.927418 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.926599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41716 (local address 127.20.132.253:33029)
0811 14:30:07.926663 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.926665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.926890 (+ 225us) server_negotiation.cc:407] Connection header received
0811 14:30:07.926989 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.926989 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.926999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.927029 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.927356 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41716: BlockingRecv error: recv got EOF from 127.0.0.1:41716 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 14:30:07.945799 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.944883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41726 (local address 127.20.132.253:33029)
0811 14:30:07.944926 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.944928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.945197 (+ 269us) server_negotiation.cc:407] Connection header received
0811 14:30:07.945309 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.945311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.945324 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.945356 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.945746 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41726: BlockingRecv error: recv got EOF from 127.0.0.1:41726 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 14:30:07.980232 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:07.979214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41736 (local address 127.20.132.253:33029)
0811 14:30:07.979261 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:07.979263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:07.979524 (+ 261us) server_negotiation.cc:407] Connection header received
0811 14:30:07.979663 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:07.979664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:07.979676 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:07.979707 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:07.980174 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41736: BlockingRecv error: recv got EOF from 127.0.0.1:41736 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 14:30:08.046475 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:08.045675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41750 (local address 127.20.132.253:33029)
0811 14:30:08.045746 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.045749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.045875 (+ 126us) server_negotiation.cc:407] Connection header received
0811 14:30:08.045955 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.045956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.045968 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.046043 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:08.046410 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41750: BlockingRecv error: recv got EOF from 127.0.0.1:41750 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 14:30:08.176791 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:08.175891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41766 (local address 127.20.132.253:33029)
0811 14:30:08.175968 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.175970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.176099 (+ 129us) server_negotiation.cc:407] Connection header received
0811 14:30:08.176238 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.176239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.176250 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.176306 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:08.176720 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41766: BlockingRecv error: recv got EOF from 127.0.0.1:41766 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 14:30:08.434880 13589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:08.434204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.20.132.253:33029)
0811 14:30:08.434271 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.434273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.434296 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:30:08.434360 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.434362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.434375 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.434442 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:08.434807 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36144: BlockingRecv error: recv got EOF from 127.0.0.1:36144 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:30:08.809705 13703 catalog_manager.cc:1259] Loaded cluster ID: a0d20b5ba18b4b7ba117dd820137dc86
I20260811 14:30:08.809789 13703 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: loading cluster ID for follower catalog manager: success
I20260811 14:30:08.810648 13703 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: acquiring CA information for follower catalog manager: success
I20260811 14:30:08.810969 13703 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 65056913fce3442987f7e8c28b363372: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:30:08.856806 13743 catalog_manager.cc:1259] Loaded cluster ID: a0d20b5ba18b4b7ba117dd820137dc86
I20260811 14:30:08.856889 13743 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: loading cluster ID for follower catalog manager: success
I20260811 14:30:08.857666 13743 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: acquiring CA information for follower catalog manager: success
I20260811 14:30:08.857915 13743 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a681e6c66d2b41c186127f98d1d1a356: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:30:08.950688 13823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:08.948176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36148 (local address 127.20.132.253:33029)
0811 14:30:08.948341 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.948344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.948358 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:30:08.948391 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.948391 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.948474 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.948549 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:08.948718 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.949224 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.949992 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.950189 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.950238 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:08.950384 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:08.950489 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:08.950548 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:08.950605 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 14:30:08.950622 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":75,"threads_started":1}
I20260811 14:30:08.955049 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:08.952726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46716 (local address 127.20.132.252:43285)
0811 14:30:08.952833 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.952835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.952843 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:30:08.952944 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.952945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.952995 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.953062 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:08.953184 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.953655 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.954338 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.954536 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.954605 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:08.954746 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:08.954826 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:08.954873 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:08.954927 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 14:30:08.954943 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":70,"threads_started":1}
I20260811 14:30:08.959940 13823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:08.957161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36160 (local address 127.20.132.253:33029)
0811 14:30:08.957231 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.957233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.957325 (+ 92us) server_negotiation.cc:407] Connection header received
0811 14:30:08.957468 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.957469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.957480 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.957530 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:08.957697 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.958423 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.959221 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.959462 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.959524 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:08.959672 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:08.959710 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:08.959765 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:08.959825 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 14:30:08.959845 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:30:08.960384 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:08.957468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46718 (local address 127.20.132.252:43285)
0811 14:30:08.957507 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.957509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.957551 (+ 42us) server_negotiation.cc:407] Connection header received
0811 14:30:08.957607 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.957607 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.957616 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.957672 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:08.957827 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.958286 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.959443 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.959705 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.959772 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:08.960073 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:08.960103 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:08.960132 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:08.960294 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 14:30:08.960338 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 14:30:08.960582 13836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:08.956978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35172 (local address 127.20.132.254:32881)
0811 14:30:08.957093 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:08.957095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:08.957106 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:30:08.957209 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:08.957210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:08.957261 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:08.957515 (+ 254us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:08.957561 (+ 46us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.958381 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.959460 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:08.959820 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:08.960037 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:08.960103 (+ 66us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:08.960228 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:08.960421 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:08.960445 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 14:30:08.960484 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":65,"threads_started":1}
I20260811 14:30:08.969273 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13417
I20260811 14:30:08.976428 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13507
I20260811 14:30:08.983275 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13592
2026-08-11T14:30:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2925 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:30:09 dist-test-slave-cbbz krb5kdc[13843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:30:09 dist-test-slave-cbbz krb5kdc[13843](info): set up 2 sockets
Aug 11 14:30:09 dist-test-slave-cbbz krb5kdc[13843](info): commencing operation
krb5kdc: starting...
W20260811 14:30:10.078692 21011 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/test-user.keytab.
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:30:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:30:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.132.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
Entry for principal kudu/127.20.132.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab.
I20260811 14:30:10.202695 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:39441
--webserver_interface=127.20.132.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:39441,127.20.132.253:36675,127.20.132.252:40827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:30:10.283625 13860 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 14:30:10.283885 13860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:10.283917 13860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:10.283962 13860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:10.285157 13860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:10.285238 13860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:10.285261 13860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:10.285281 13860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:10.285310 13860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:10.286787 13860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:39441,127.20.132.253:36675,127.20.132.252:40827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.254.keytab
--principal=kudu/127.20.132.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.254:39441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.132.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:10.287057 13860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:10.287286 13860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:10.292229 13866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:10.292248 13868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:10.292330 13860 server_base.cc:1034] running on GCE node
W20260811 14:30:10.292192 13865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:10.292649 13860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:10.292968 13860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:10.294167 13860 hybrid_clock.cc:648] HybridClock initialized: now 1786458610294145 us; error 37 us; skew 500 ppm
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:10.296911 13860 init.cc:377] Logged in from keytab as kudu/127.20.132.254@KRBTEST.COM (short username kudu)
I20260811 14:30:10.297374 13860 webserver.cc:460] Webserver started at http://127.20.132.254:38395/ using document root <none> and password file <none>
I20260811 14:30:10.297559 13860 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:10.297605 13860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:10.297698 13860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:10.298717 13860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data/instance:
uuid: "1a59c80b338744d68bf426225aaed2fe"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "97ad280e4601e7479e1c714cb75faaf9"
server_key_iv: "136c6352c73b6a64d2f766d7b17762bf"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.299050 13860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal/instance:
uuid: "1a59c80b338744d68bf426225aaed2fe"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "97ad280e4601e7479e1c714cb75faaf9"
server_key_iv: "136c6352c73b6a64d2f766d7b17762bf"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.300416 13860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 14:30:10.301209 13876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:10.301421 13860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:30:10.301505 13860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal
uuid: "1a59c80b338744d68bf426225aaed2fe"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "97ad280e4601e7479e1c714cb75faaf9"
server_key_iv: "136c6352c73b6a64d2f766d7b17762bf"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.301559 13860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:10.318456 13860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:10.320772 13860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:10.320883 13860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:10.324965 13860 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.254:39441
I20260811 14:30:10.325073 13931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.254:39441 every 8 connection(s)
I20260811 14:30:10.325377 13860 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/data/info.pb
I20260811 14:30:10.326273 13932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:10.327613 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13860
I20260811 14:30:10.327698 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-0/wal/instance
I20260811 14:30:10.327903 21011 external_mini_cluster.cc:1428] Setting key bd8702246c2bcd6db4365b669d7580d3
I20260811 14:30:10.328003 13932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.132.253@KRBTEST.COM; defaulting to no policy
I20260811 14:30:10.339334 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.328825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:39441 (local address 127.0.0.1:60542)
0811 14:30:10.329006 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.329053 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.329654 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.329971 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.329974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.330347 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.330593 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.330600 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.331590 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.331591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.332807 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.332811 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.333309 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.333310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.333409 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.333951 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.333961 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.335669 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.337907 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.337914 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.337915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.338113 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.338354 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.338354 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.338355 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.338438 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.338872 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.338877 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.338934 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.339010 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.339145 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
I20260811 14:30:10.339339 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.328881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60542 (local address 127.20.132.254:39441)
0811 14:30:10.329073 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.329078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.329151 (+ 73us) server_negotiation.cc:407] Connection header received
0811 14:30:10.329832 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.329835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.329851 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.329927 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.330708 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.331484 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.332900 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.333205 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.333287 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.335770 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.335778 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.335778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.335786 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.337817 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.338197 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.338200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.338200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.338285 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.338502 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.338503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.338503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.338804 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.338878 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.339096 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.339210 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":167,"thread_start_us":96,"threads_started":1}
I20260811 14:30:10.340255 13932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.253@KRBTEST.COM" created.
I20260811 14:30:10.340631 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.340506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54136)
0811 14:30:10.340559 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.340613 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 14:30:10.340790 13878 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
I20260811 14:30:10.341216 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.341118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54152)
0811 14:30:10.341169 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.341193 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 14:30:10.341320 13932 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:36675: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab.
Entry for principal kudu/127.20.132.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab.
I20260811 14:30:10.355288 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:36675
--webserver_interface=127.20.132.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab
--principal=kudu/127.20.132.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:39441,127.20.132.253:36675,127.20.132.252:40827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:30:10.390566 13932 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } attempt: 1
I20260811 14:30:10.391080 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.390918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54156)
0811 14:30:10.390989 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.391028 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 14:30:10.391443 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.391344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54170)
0811 14:30:10.391391 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.391416 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:30:10.391536 13932 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:36675: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
W20260811 14:30:10.436468 13940 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 14:30:10.436710 13940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:10.436741 13940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:10.436802 13940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:10.437945 13940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:10.438009 13940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:10.438036 13940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:10.438067 13940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:10.438097 13940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:10.439522 13940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:39441,127.20.132.253:36675,127.20.132.252:40827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.253.keytab
--principal=kudu/127.20.132.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.253:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.132.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:10.439810 13940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:10.440084 13940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:10.444814 13945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:10.444903 13946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:10.444815 13948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:10.444921 13940 server_base.cc:1034] running on GCE node
I20260811 14:30:10.445278 13940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:10.445609 13940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:10.446776 13940 hybrid_clock.cc:648] HybridClock initialized: now 1786458610446764 us; error 45 us; skew 500 ppm
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:10.449717 13940 init.cc:377] Logged in from keytab as kudu/127.20.132.253@KRBTEST.COM (short username kudu)
I20260811 14:30:10.450143 13940 webserver.cc:460] Webserver started at http://127.20.132.253:34513/ using document root <none> and password file <none>
I20260811 14:30:10.450341 13940 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:10.450382 13940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:10.450469 13940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:10.451498 13940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data/instance:
uuid: "05240ba3389942829a8e6b2beb472bca"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "9f06cf242fc2d356ac00c00c2395b200"
server_key_iv: "4fcff8f4b84a626d4e2e1005107f680f"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.451803 13940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal/instance:
uuid: "05240ba3389942829a8e6b2beb472bca"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "9f06cf242fc2d356ac00c00c2395b200"
server_key_iv: "4fcff8f4b84a626d4e2e1005107f680f"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.453181 13940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 14:30:10.453886 13956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:10.454097 13940 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:30:10.454165 13940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal
uuid: "05240ba3389942829a8e6b2beb472bca"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "9f06cf242fc2d356ac00c00c2395b200"
server_key_iv: "4fcff8f4b84a626d4e2e1005107f680f"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.454258 13940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:10.459668 13932 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } attempt: 2
I20260811 14:30:10.460041 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.459920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54174)
0811 14:30:10.459978 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.460015 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 14:30:10.460397 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.460302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54184)
0811 14:30:10.460346 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.460371 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 14:30:10.460484 13932 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.253:36675: Network error: Client connection negotiation failed: client connection to 127.20.132.253:36675: connect: Connection refused (error 111)
I20260811 14:30:10.465649 13940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:10.467895 13940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:10.468053 13940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:10.472517 13940 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.253:36675
I20260811 14:30:10.472569 14015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.253:36675 every 8 connection(s)
I20260811 14:30:10.472940 13940 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/data/info.pb
I20260811 14:30:10.473788 14016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:10.475313 14016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:10.480595 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 13940
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:10.480726 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-1/wal/instance
I20260811 14:30:10.480942 21011 external_mini_cluster.cc:1428] Setting key b52ce50e05e8f97c862aea2609bf982a
I20260811 14:30:10.484052 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.476003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60552 (local address 127.20.132.254:39441)
0811 14:30:10.476081 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.476084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.476323 (+ 239us) server_negotiation.cc:407] Connection header received
0811 14:30:10.476754 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.476755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.476768 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.476820 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.477377 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.477854 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.478777 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.478971 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.479039 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.481249 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.481251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.481251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.481259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.482705 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.483092 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.483094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.483094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.483163 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.483396 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.483397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.483397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.483542 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.483640 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.483923 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.483991 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 14:30:10.484334 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.475963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:39441 (local address 127.0.0.1:60552)
0811 14:30:10.476204 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.476240 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.476672 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.476870 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.476872 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.477123 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.477304 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.477307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.477930 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.477931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.478695 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.478697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.479078 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.479079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.479170 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.479601 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.479608 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.481130 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.482795 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.482801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.482802 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.483017 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.483232 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.483232 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.483232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.483331 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.483633 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.483637 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.483769 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.483881 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.484039 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":123,"threads_started":1}
I20260811 14:30:10.484965 14016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.132.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.132.252@KRBTEST.COM" created.
I20260811 14:30:10.492691 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.485230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54190)
0811 14:30:10.485277 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.485288 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.485330 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.485589 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.485590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.485747 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.485816 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.485818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.486647 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.486648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.487493 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.487495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.487943 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.487945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.488023 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.488398 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.488403 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.489644 (+ 1241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.491518 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.491519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.491519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.491704 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.491927 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.491928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.491929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.491985 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.492328 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.492329 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.492365 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.492473 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.492582 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 14:30:10.492772 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.485285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54190 (local address 127.20.132.253:36675)
0811 14:30:10.485432 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.485436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.485459 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:30:10.485475 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.485476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.485485 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.485544 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.485896 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.486555 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.487581 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.487866 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.487914 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.489731 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.489739 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.489739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.489746 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.491412 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.491797 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.491800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.491800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.491860 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.492052 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.492053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.492053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.492252 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.492352 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.492507 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.492637 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260811 14:30:10.493309 14016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:10.493643 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.493524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48408)
0811 14:30:10.493569 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.493613 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 14:30:10.493774 13960 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
I20260811 14:30:10.494212 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.494121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48410)
0811 14:30:10.494167 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.494190 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 14:30:10.494333 14016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:40827: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.132.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab.
Entry for principal kudu/127.20.132.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab.
I20260811 14:30:10.509121 21011 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2EBArE/build/release/bin/kudu
/tmp/dist-test-task2EBArE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:40827
--webserver_interface=127.20.132.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab
--principal=kudu/127.20.132.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.132.212:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.132.254:39441,127.20.132.253:36675,127.20.132.252:40827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:30:10.543574 14016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } attempt: 1
I20260811 14:30:10.544186 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.543995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48416)
0811 14:30:10.544063 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.544112 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 14:30:10.544616 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.544521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48426)
0811 14:30:10.544564 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.544597 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 14:30:10.544734 14016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:40827: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
I20260811 14:30:10.551635 13932 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } attempt: 3
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
I20260811 14:30:10.558763 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.551982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54192)
0811 14:30:10.552040 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.552052 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.552159 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.552336 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.552337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.552514 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.552580 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.552582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.553244 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.553246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.553778 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.553780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.554186 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.554187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.554268 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.554734 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.554741 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.556058 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.557844 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.557845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.557845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.558010 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.558216 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.558217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.558217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.558268 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.558521 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.558521 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.558559 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.558623 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.558696 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 14:30:10.558827 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.552044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54192 (local address 127.20.132.253:36675)
0811 14:30:10.552091 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.552094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.552122 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:30:10.552247 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.552248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.552259 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.552329 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.552662 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.553156 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.553872 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.554102 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.554188 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.556161 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.556162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.556163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.556170 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.557751 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.558081 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.558082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.558082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.558143 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.558325 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.558325 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.558326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.558457 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.558523 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.558663 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.558740 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 14:30:10.559231 13932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:10.559587 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.559475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48440)
0811 14:30:10.559525 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.559551 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:30:10.559937 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.559855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48450)
0811 14:30:10.559900 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.559922 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 14:30:10.560035 13932 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:40827: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
I20260811 14:30:10.591166 13932 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } attempt: 1
I20260811 14:30:10.591622 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.591492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48466)
0811 14:30:10.591554 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.591596 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 14:30:10.592000 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.591910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48478)
0811 14:30:10.591964 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.591985 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 14:30:10.592110 13932 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:40827: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
W20260811 14:30:10.593032 14024 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 14:30:10.593248 14024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:30:10.593287 14024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:30:10.593326 14024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:30:10.594449 14024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:30:10.594511 14024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:30:10.594535 14024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:30:10.594563 14024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:30:10.594590 14024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:30:10.596027 14024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.132.212:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.132.254:39441,127.20.132.253:36675,127.20.132.252:40827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/krb5kdc/kudu_127.20.132.252.keytab
--principal=kudu/127.20.132.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.132.252:40827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.132.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 13:41:36 UTC on ccycloud.quasar-ebruqk.root.comops.site
build id 4580675
I20260811 14:30:10.596304 14024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:30:10.596529 14024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:30:10.601081 14032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:10.601114 14029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:30:10.601114 14030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:30:10.601366 14024 server_base.cc:1034] running on GCE node
I20260811 14:30:10.602388 14024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:30:10.602674 14024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:30:10.603917 14024 hybrid_clock.cc:648] HybridClock initialized: now 1786458610603864 us; error 40 us; skew 500 ppm
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:30:10.606694 14024 init.cc:377] Logged in from keytab as kudu/127.20.132.252@KRBTEST.COM (short username kudu)
I20260811 14:30:10.607147 14024 webserver.cc:460] Webserver started at http://127.20.132.252:34281/ using document root <none> and password file <none>
I20260811 14:30:10.607367 14024 fs_manager.cc:359] Metadata directory not provided
I20260811 14:30:10.607435 14024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:30:10.607589 14024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:30:10.608683 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data/instance:
uuid: "f5820da2dd374f848ef73133da8beff3"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "cf55fea08fb87474cff193e59df30ff1"
server_key_iv: "dcad6eca08d8dddc1b32594188d6e773"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.609042 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal/instance:
uuid: "f5820da2dd374f848ef73133da8beff3"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "cf55fea08fb87474cff193e59df30ff1"
server_key_iv: "dcad6eca08d8dddc1b32594188d6e773"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.610374 14024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:30:10.611150 14040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:30:10.611322 14024 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:30:10.611421 14024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data,/tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal
uuid: "f5820da2dd374f848ef73133da8beff3"
format_stamp: "Formatted at 2026-08-11 14:30:10 on dist-test-slave-cbbz"
server_key: "cf55fea08fb87474cff193e59df30ff1"
server_key_iv: "dcad6eca08d8dddc1b32594188d6e773"
server_key_version: "encryptionkey@0"
I20260811 14:30:10.611500 14024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:30:10.612907 14016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } attempt: 2
I20260811 14:30:10.613344 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.613208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48492)
0811 14:30:10.613271 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.613309 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 14:30:10.613806 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.613692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48500)
0811 14:30:10.613744 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.613776 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 14:30:10.613934 14016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.132.252:40827: Network error: Client connection negotiation failed: client connection to 127.20.132.252:40827: connect: Connection refused (error 111)
I20260811 14:30:10.622342 14024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:30:10.624255 14024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:30:10.624362 14024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:30:10.628382 14024 rpc_server.cc:307] RPC server started. Bound to: 127.20.132.252:40827
I20260811 14:30:10.628414 14095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.132.252:40827 every 8 connection(s)
I20260811 14:30:10.628765 14024 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/data/info.pb
I20260811 14:30:10.629634 14096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:30:10.631170 14096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:10.633996 21011 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2EBArE/build/release/bin/kudu as pid 14024
I20260811 14:30:10.634112 21011 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2EBArE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786458335845753-21011-0/minicluster-data/master-2/wal/instance
I20260811 14:30:10.634320 21011 external_mini_cluster.cc:1428] Setting key e57fd48aa5925e5ee5dbb9cfb7d925db
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:30:10.641399 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.631856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60566 (local address 127.20.132.254:39441)
0811 14:30:10.631936 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.631938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.632090 (+ 152us) server_negotiation.cc:407] Connection header received
0811 14:30:10.632569 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.632570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.632580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.632642 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.633254 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.633733 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.635112 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.635425 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.635499 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.637921 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.637922 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.637923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.637930 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.639611 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.640192 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.640193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.640194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.640258 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.640614 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.640615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.640615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.640770 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.640861 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.641190 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.641280 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 14:30:10.641592 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.631803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.254:39441 (local address 127.0.0.1:60566)
0811 14:30:10.631972 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.632008 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.632477 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.632698 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.632700 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.632950 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.633134 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.633138 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.633837 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.633838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.635027 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.635029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.635514 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.635515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.635606 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.636084 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.636093 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.637836 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.639716 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.639724 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.639726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.640066 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.640339 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.640340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.640340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.640487 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.640853 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.640860 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.641026 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.641152 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.641325 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260811 14:30:10.643600 14096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:10.644562 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.634706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48516 (local address 127.20.132.252:40827)
0811 14:30:10.634859 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.634863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.634904 (+ 41us) server_negotiation.cc:407] Connection header received
0811 14:30:10.634962 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.634964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.634984 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.635058 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.635853 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.636905 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.637831 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.638210 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.638290 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.641024 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.641031 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.641032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.641039 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.643029 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.643493 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.643496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.643496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.643583 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.643804 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.643805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.643805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.643977 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.644118 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.644377 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.644462 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.254@KRBTEST.COM
I20260811 14:30:10.652035 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.643999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54206 (local address 127.20.132.253:36675)
0811 14:30:10.644051 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.644053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.644063 (+ 10us) server_negotiation.cc:407] Connection header received
0811 14:30:10.644089 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.644090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.644100 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.644213 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.644546 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.645116 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.646031 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.646389 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.646436 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.648669 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.648671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.648671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.648679 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.650339 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.651187 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.651189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.651189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.651261 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.651459 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.651460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.651461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.651607 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.651674 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.651870 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.651942 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 14:30:10.652040 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.643864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.253:36675 (local address 127.0.0.1:54206)
0811 14:30:10.643960 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.643970 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.644006 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.644216 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.644217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.644389 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.644448 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.644450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.645196 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.645197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.645937 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.645940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.646519 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.646520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.646598 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.647115 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.647120 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.648575 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.650931 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.650932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.650933 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.651088 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.651328 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.651329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.651329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.651390 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.651704 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.651705 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.651748 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.651842 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.651942 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 14:30:10.652513 14096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:30:10.654253 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.645770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60572 (local address 127.20.132.254:39441)
0811 14:30:10.645837 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.645839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.645850 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:30:10.645922 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.645923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.645933 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.645964 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.646572 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.647392 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.648425 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.648656 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.648719 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.651294 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.651296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.651296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.651303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.653090 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.653449 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.653451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.653451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.653507 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.653727 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.653728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.653728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.653839 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.654034 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.654071 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.654157 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.252@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:30:10.659320 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.652785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48530)
0811 14:30:10.652814 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.652824 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.652860 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.652973 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.652974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.653102 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.653127 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.653129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.653740 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.653741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.654219 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.654221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.654813 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.654814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.654855 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.655228 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.655233 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.656367 (+ 1134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.658137 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.658138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.658138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.658317 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.658562 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.658563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.658563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.658626 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.658943 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.658944 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.658992 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.659080 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.659189 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260811 14:30:10.659327 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.652817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48530 (local address 127.20.132.252:40827)
0811 14:30:10.652877 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.652878 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.652886 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:30:10.652905 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.652906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.652916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.652970 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.653207 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.653658 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.654407 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.654742 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.654806 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.656448 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.656450 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.656450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.656457 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.658040 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.658388 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.658389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.658389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.658457 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.658704 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.658706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.658706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.658840 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.658904 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.659116 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.659238 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":45}
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.132.253@KRBTEST.COM
I20260811 14:30:10.660880 14096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: Bootstrap starting.
I20260811 14:30:10.661744 14096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:10.662050 14096 log.cc:824] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:10.662627 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.654905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54210 (local address 127.20.132.253:36675)
0811 14:30:10.654972 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.654974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.654997 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:30:10.655016 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.655017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.655026 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.655074 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.655594 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.656036 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.656937 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.657263 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.657331 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.659950 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.659952 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.659952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.659959 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.661455 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.661822 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.661824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.661824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.661881 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.662081 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.662082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.662082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.662207 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.662398 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.662433 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.662503 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:30:10.662879 14096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: No bootstrap required, opened a new log
I20260811 14:30:10.664095 21011 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:30:10.664954 14096 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.665110 14096 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5820da2dd374f848ef73133da8beff3, State: Initialized, Role: FOLLOWER
I20260811 14:30:10.665199 14096 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.665470 14102 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.665597 14102 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.665527 14096 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:10.665292 13905 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1a59c80b338744d68bf426225aaed2fe"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60572
I20260811 14:30:10.667243 13932 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } attempt: 2
W20260811 14:30:10.667508 14114 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:30:10.667618 14114 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:30:10.668093 14024 master_runner.cc:186] Error getting master registration for 127.20.132.254:39441: OK, instance_id { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" instance_seqno: 1786458610323679 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 14:30:10.670939 14024 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.254@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:30:10.675184 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.667487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48536)
0811 14:30:10.667542 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.667555 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.667601 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.667763 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.667764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.667972 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.668015 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.668017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.668919 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.668920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.669692 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.669695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.670195 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.670196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.670255 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.670712 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.670717 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.672191 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.674034 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.674035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.674036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.674295 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.674508 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.674509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.674509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.674572 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.674879 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.674880 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.674923 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.674992 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.675084 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 14:30:10.675211 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.667614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48536 (local address 127.20.132.252:40827)
0811 14:30:10.667648 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.667650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.667657 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:30:10.667677 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.667678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.667687 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.667742 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.668075 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.668821 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.669790 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.670079 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.670143 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.672281 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.672283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.672284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.672291 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.673923 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.674375 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.674376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.674377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.674437 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.674641 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.674642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.674642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.674808 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.674882 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.675035 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.675125 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 14:30:10.676772 13932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe: Bootstrap starting.
I20260811 14:30:10.677524 13932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:10.677853 13932 log.cc:824] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:10.678791 13932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe: No bootstrap required, opened a new log
I20260811 14:30:10.680207 13932 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.680349 13932 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a59c80b338744d68bf426225aaed2fe, State: Initialized, Role: FOLLOWER
I20260811 14:30:10.680428 13932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.680724 13932 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:10.680675 14117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.680768 13905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 14:30:10.680792 14117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.680827 13905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:10.681528 13905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.682014 14068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a59c80b338744d68bf426225aaed2fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f5820da2dd374f848ef73133da8beff3"
I20260811 14:30:10.682137 14068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:10.683107 14068 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a59c80b338744d68bf426225aaed2fe in term 1.
I20260811 14:30:10.683373 13880 leader_election.cc:302] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a59c80b338744d68bf426225aaed2fe, f5820da2dd374f848ef73133da8beff3; no voters:
I20260811 14:30:10.683518 14117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:30:10.683655 14117 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [term 1 LEADER]: Becoming Leader. State: Replica: 1a59c80b338744d68bf426225aaed2fe, State: Running, Role: LEADER
W20260811 14:30:10.683697 14129 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 14:30:10.683753 14117 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.684000 13905 leader_election.cc:288] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [CANDIDATE]: Term 1 election: Requested vote from peers 05240ba3389942829a8e6b2beb472bca (127.20.132.253:36675), f5820da2dd374f848ef73133da8beff3 (127.20.132.252:40827)
I20260811 14:30:10.684259 14117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a59c80b338744d68bf426225aaed2fe. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.684376 14117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: This master's current role is: LEADER
W20260811 14:30:10.683763 14129 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:30:10.683172 13860 master_runner.cc:186] Error getting master registration for 127.20.132.253:36675: OK, instance_id { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" instance_seqno: 1786458610471200 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 14:30:10.685346 13860 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 14:30:10.685294 14136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:30:10.685591 14136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:30:10.693065 14068 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [term 1 FOLLOWER]: Refusing update from remote peer 1a59c80b338744d68bf426225aaed2fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:30:10.693393 14131 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:30:10.694672 14102 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a59c80b338744d68bf426225aaed2fe. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.694782 14102 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.697569 13935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.685277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60574 (local address 127.20.132.254:39441)
0811 14:30:10.685317 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.685319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.685910 (+ 591us) server_negotiation.cc:407] Connection header received
0811 14:30:10.686077 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.686078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.686089 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.686120 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.687108 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.687839 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.689036 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.689319 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.689388 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.691489 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.691491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.691491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.691498 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.695462 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.696101 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.696102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.696102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.696223 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.696607 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.696608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.696609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.696823 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.696975 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.697307 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.697434 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 14:30:10.699570 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.685753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48548 (local address 127.20.132.252:40827)
0811 14:30:10.685797 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.685798 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.687188 (+ 1390us) server_negotiation.cc:407] Connection header received
0811 14:30:10.687276 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.687277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.687286 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.687324 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.688010 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.688692 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.689941 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.690641 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.690705 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.692785 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.692786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.692786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.692793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.695227 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.697757 (+ 2530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.697758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.697758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.697813 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.698394 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.698395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.698395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.698534 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.698610 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.699376 (+ 766us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.699470 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 14:30:10.701119 14117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.701226 14117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:10.701303 14102 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.701355 14143 mvcc.cc:205] Tried to move back new op lower bound from 7317334469396193280 to 7317334469361418240. Current Snapshot: MvccSnapshot[applied={T|T < 7317334469396193280}]
I20260811 14:30:10.701385 14102 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.701519 14145 mvcc.cc:205] Tried to move back new op lower bound from 7317334469396193280 to 7317334469361418240. Current Snapshot: MvccSnapshot[applied={T|T < 7317334469396193280}]
I20260811 14:30:10.702150 14136 catalog_manager.cc:1347] Generated new cluster ID: 45e60ea9d7674892b0c4bdb5015c7771
I20260811 14:30:10.702203 14136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:30:10.702495 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.686396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54212 (local address 127.20.132.253:36675)
0811 14:30:10.686444 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.686446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.692375 (+ 5929us) server_negotiation.cc:407] Connection header received
0811 14:30:10.692503 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.692504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.692524 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.692560 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.693220 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.693883 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.695812 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.696122 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.696207 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.699527 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.699529 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.699529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.699536 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.701229 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.701639 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.701641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.701641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.701698 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.701920 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.701921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.701921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.702054 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.702130 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.702328 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.702406 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 14:30:10.705081 14016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } attempt: 3
Aug 11 14:30:10 dist-test-slave-cbbz krb5kdc[13843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786458610, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.132.253@KRBTEST.COM for kudu/127.20.132.252@KRBTEST.COM
I20260811 14:30:10.713171 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.705319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.132.252:40827 (local address 127.0.0.1:48556)
0811 14:30:10.705362 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 14:30:10.705372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 14:30:10.705410 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:30:10.705829 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:30:10.705830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:30:10.705985 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:30:10.706021 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.706023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.706912 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.706913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.707726 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:30:10.707728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.708261 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.708262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:30:10.708335 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.708799 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:30:10.708804 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:30:10.710235 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:30:10.712084 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.712085 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.712085 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.712337 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.712537 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:30:10.712538 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:30:10.712538 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:30:10.712601 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:30:10.712851 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:30:10.712852 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:30:10.712911 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 14:30:10.712984 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 14:30:10.713076 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 14:30:10.713198 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:10.705346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48556 (local address 127.20.132.252:40827)
0811 14:30:10.705377 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.705379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.705640 (+ 261us) server_negotiation.cc:407] Connection header received
0811 14:30:10.705662 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.705662 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.705672 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.705716 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.706111 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.706822 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.707814 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:10.708105 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:10.708236 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:10.710324 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:30:10.710326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:30:10.710326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:30:10.710351 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:30:10.711979 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.712402 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.712403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.712404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.712461 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:30:10.712666 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:30:10.712667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:30:10.712667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:30:10.712782 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:30:10.712844 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:10.713023 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 14:30:10.713103 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 14:30:10.715093 14016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: Bootstrap starting.
I20260811 14:30:10.715842 14016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: Neither blocks nor log segments found. Creating new log.
I20260811 14:30:10.716117 14016 log.cc:824] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: Log is configured to *not* fsync() on all Append() calls
I20260811 14:30:10.717281 14016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: No bootstrap required, opened a new log
I20260811 14:30:10.719657 14016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.719796 14016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05240ba3389942829a8e6b2beb472bca, State: Initialized, Role: FOLLOWER
I20260811 14:30:10.719882 14016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } }
I20260811 14:30:10.720234 14016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:30:10.720278 13985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:30:10.721257 13985 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [term 1 FOLLOWER]: Refusing update from remote peer 1a59c80b338744d68bf426225aaed2fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:30:10.721454 13986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a59c80b338744d68bf426225aaed2fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "05240ba3389942829a8e6b2beb472bca"
I20260811 14:30:10.722029 14136 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:30:10.722481 14117 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:30:10.722744 13986 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a59c80b338744d68bf426225aaed2fe in term 1.
I20260811 14:30:10.723183 14136 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:30:10.726754 14151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.726897 14151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.726976 14151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a59c80b338744d68bf426225aaed2fe. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.727057 14151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.727115 14151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.727197 14151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:30:10.728340 14164 mvcc.cc:205] Tried to move back new op lower bound from 7317334469494894592 to 7317334469361418240. Current Snapshot: MvccSnapshot[applied={T|T < 7317334469396193280}]
W20260811 14:30:10.728864 14162 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:30:10.728921 14162 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:30:10.732062 14117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1a59c80b338744d68bf426225aaed2fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a59c80b338744d68bf426225aaed2fe" member_type: VOTER last_known_addr { host: "127.20.132.254" port: 39441 } } peers { permanent_uuid: "05240ba3389942829a8e6b2beb472bca" member_type: VOTER last_known_addr { host: "127.20.132.253" port: 36675 } } peers { permanent_uuid: "f5820da2dd374f848ef73133da8beff3" member_type: VOTER last_known_addr { host: "127.20.132.252" port: 40827 } } }
I20260811 14:30:10.732187 14117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe [sys.catalog]: This master's current role is: LEADER
I20260811 14:30:10.733423 14136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a59c80b338744d68bf426225aaed2fe: Generated new TSK 0
I20260811 14:30:10.733592 14136 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:30:10.760300 13935 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.758663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60586 (local address 127.20.132.254:39441)
0811 14:30:10.758708 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.758710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.759603 (+ 893us) server_negotiation.cc:407] Connection header received
0811 14:30:10.759712 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.759713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.759724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.759755 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.760219 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60586: BlockingRecv error: recv got EOF from 127.0.0.1:60586 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 14:30:10.761233 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.759327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54224 (local address 127.20.132.253:36675)
0811 14:30:10.759366 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.759368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.760710 (+ 1342us) server_negotiation.cc:407] Connection header received
0811 14:30:10.760799 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.760800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.760811 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.760838 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.761175 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54224: BlockingRecv error: recv got EOF from 127.0.0.1:54224 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 14:30:10.764597 14100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.759016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.20.132.252:40827)
0811 14:30:10.759073 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.759075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.760505 (+ 1430us) server_negotiation.cc:407] Connection header received
0811 14:30:10.760588 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.760589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.760600 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.760655 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.764526 (+ 3871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48562: BlockingRecv error: recv got EOF from 127.0.0.1:48562 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 14:30:10.769230 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.768442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.20.132.253:36675)
0811 14:30:10.768481 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.768483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.768713 (+ 230us) server_negotiation.cc:407] Connection header received
0811 14:30:10.768823 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.768824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.768844 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.768873 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.769180 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54234: BlockingRecv error: recv got EOF from 127.0.0.1:54234 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 14:30:10.772326 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.771493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54248 (local address 127.20.132.253:36675)
0811 14:30:10.771525 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.771527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.771768 (+ 241us) server_negotiation.cc:407] Connection header received
0811 14:30:10.771866 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.771867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.771876 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.771905 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.772283 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54248: BlockingRecv error: recv got EOF from 127.0.0.1:54248 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 14:30:10.776225 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.775474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.20.132.253:36675)
0811 14:30:10.775506 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.775507 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.775723 (+ 216us) server_negotiation.cc:407] Connection header received
0811 14:30:10.775815 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.775816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.775825 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.775854 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.776185 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54260: BlockingRecv error: recv got EOF from 127.0.0.1:54260 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 14:30:10.782133 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.781305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54276 (local address 127.20.132.253:36675)
0811 14:30:10.781338 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.781340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.781627 (+ 287us) server_negotiation.cc:407] Connection header received
0811 14:30:10.781728 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.781729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.781739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.781780 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.782091 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54276: BlockingRecv error: recv got EOF from 127.0.0.1:54276 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 14:30:10.792383 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.791370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.20.132.253:36675)
0811 14:30:10.791436 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.791438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.791715 (+ 277us) server_negotiation.cc:407] Connection header received
0811 14:30:10.791818 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.791819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.791829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.791876 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.792319 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54282: BlockingRecv error: recv got EOF from 127.0.0.1:54282 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 14:30:10.810701 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.809734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54288 (local address 127.20.132.253:36675)
0811 14:30:10.809812 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.809814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.810089 (+ 275us) server_negotiation.cc:407] Connection header received
0811 14:30:10.810194 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.810195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.810207 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.810238 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.810645 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54288: BlockingRecv error: recv got EOF from 127.0.0.1:54288 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 14:30:10.845093 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.844128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54294 (local address 127.20.132.253:36675)
0811 14:30:10.844212 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.844214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.844510 (+ 296us) server_negotiation.cc:407] Connection header received
0811 14:30:10.844623 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.844624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.844636 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.844665 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.845030 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54294: BlockingRecv error: recv got EOF from 127.0.0.1:54294 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 14:30:10.911182 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:10.910455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54296 (local address 127.20.132.253:36675)
0811 14:30:10.910550 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:10.910552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:10.910617 (+ 65us) server_negotiation.cc:407] Connection header received
0811 14:30:10.910661 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:10.910662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:10.910672 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:10.910724 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:10.911092 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54296: BlockingRecv error: recv got EOF from 127.0.0.1:54296 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 14:30:11.041263 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:11.040484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54298 (local address 127.20.132.253:36675)
0811 14:30:11.040572 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.040574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.040663 (+ 89us) server_negotiation.cc:407] Connection header received
0811 14:30:11.040710 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.040711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.040722 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.040790 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:11.041195 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54298: BlockingRecv error: recv got EOF from 127.0.0.1:54298 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 14:30:11.299535 14021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:30:11.298794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.20.132.253:36675)
0811 14:30:11.298875 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.298877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.298890 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:30:11.298949 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.298951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.298971 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.299065 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:30:11.299449 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54304: BlockingRecv error: recv got EOF from 127.0.0.1:54304 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:30:11.668128 14114 catalog_manager.cc:1259] Loaded cluster ID: 45e60ea9d7674892b0c4bdb5015c7771
I20260811 14:30:11.668237 14114 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: loading cluster ID for follower catalog manager: success
I20260811 14:30:11.669006 14114 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: acquiring CA information for follower catalog manager: success
I20260811 14:30:11.669275 14114 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5820da2dd374f848ef73133da8beff3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:30:11.729403 14162 catalog_manager.cc:1259] Loaded cluster ID: 45e60ea9d7674892b0c4bdb5015c7771
I20260811 14:30:11.729490 14162 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: loading cluster ID for follower catalog manager: success
I20260811 14:30:11.730230 14162 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: acquiring CA information for follower catalog manager: success
I20260811 14:30:11.730479 14162 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 05240ba3389942829a8e6b2beb472bca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 14:30:11.815711 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:11.812839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54308 (local address 127.20.132.253:36675)
0811 14:30:11.812951 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.812953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.813040 (+ 87us) server_negotiation.cc:407] Connection header received
0811 14:30:11.813147 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.813148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.813203 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.813280 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:11.813507 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.814067 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.814846 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.815059 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.815149 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:11.815312 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:11.815424 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:11.815485 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:11.815583 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 14:30:11.815602 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":63,"threads_started":1}
I20260811 14:30:11.820281 14252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:11.817612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.20.132.252:40827)
0811 14:30:11.817753 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.817756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.817764 (+ 8us) server_negotiation.cc:407] Connection header received
0811 14:30:11.817871 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.817872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.817928 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.818018 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:11.818156 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.818647 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.819397 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.819619 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.819717 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:11.819876 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:11.819990 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:11.820092 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:11.820160 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 14:30:11.820183 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260811 14:30:11.825191 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:11.822383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54312 (local address 127.20.132.253:36675)
0811 14:30:11.822427 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.822428 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.822591 (+ 163us) server_negotiation.cc:407] Connection header received
0811 14:30:11.822647 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.822648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.822659 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.822732 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:11.822890 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.823376 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.824407 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.824695 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.824767 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:11.824907 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:11.824937 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:11.824986 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:11.825066 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 14:30:11.825087 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 14:30:11.825649 14261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:11.822402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60600 (local address 127.20.132.254:39441)
0811 14:30:11.822524 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.822525 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.822532 (+ 7us) server_negotiation.cc:407] Connection header received
0811 14:30:11.822588 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.822589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.822642 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.822874 (+ 232us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:11.822918 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.823672 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.824627 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.824942 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.825213 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:11.825281 (+ 68us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:11.825388 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:11.825469 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:11.825533 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 14:30:11.825561 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
I20260811 14:30:11.825955 14252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:30:11.822278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48576 (local address 127.20.132.252:40827)
0811 14:30:11.822317 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 14:30:11.822319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 14:30:11.822586 (+ 267us) server_negotiation.cc:407] Connection header received
0811 14:30:11.822694 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:30:11.822695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:30:11.822705 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:30:11.822805 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:30:11.822941 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.823654 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.825185 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:30:11.825441 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:30:11.825486 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:30:11.825712 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:30:11.825748 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:30:11.825796 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:30:11.825861 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 14:30:11.825884 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 14:30:11.827271 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13860
I20260811 14:30:11.834962 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 13940
I20260811 14:30:11.843637 21011 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2EBArE/build/release/bin/kudu with pid 14024
2026-08-11T14:30:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2862 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5787 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (276004 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST